MICROCOPY  RESOLUTION  TEST  CHART 

NATIONAL  BUREAU  OE  STANDARDS-  196J-A 


Unc/g<Srf*c.J _ 

SECURITY  CLASsIfICA  rtOM  OF  THIS  PACE  (Wimi  O.l.  Enf*r,rf) 


DOCUMENTATION  PAGE 


( Jm.cJ6.ss>  "ft 


READ  INSTRUCTIONS 
BEFORE  COMPLETING  FORM 


1.  RECIPIENT'S  CATALOG  NUMBER 


4.  TITLE  (mut  Subtitle) 

(h) MAINTENANCE  ^ODUCTIVITY, 


7.  AUTHOROJ 

Id)  Charles  R./ White  t 


S.  CONTRACT  OP  GRANT  NUMBER^) 


/'  )  J_  /■  /  /  15*  *"AFC?SR-79-0jol6  (J 


9.  performing  organization  name  ano  address 

Department  of  Industrial  Engineering 
Auburn  University,  AL  36849 


10.  PROGRAM  ELEMENT.  PROJECT.  TASK 
yS  AREA  A  WORK  UNIT  NUMBERS 


It.  REPORT  DATE 

September  1980 


II.  NUMBER  OF  PACES 


I*.  MONITORING  AGENCY  NAME  a  AODRESSf//  dlltoront  from  Controlling  OllleoJ  IS.  SECURITY  CLASS,  fof  ml*  import) 

Unclassified 

I5«.  DECLASSIFICATION/ DOWNGRADING 
SCHEDULE 


16.  DISTRIBUTION  STATEMENT  (at  thlo  Roport) 

Approved  for  public  release;  distribution  unlimited 


*7.  DISTRIBUTION  STATEMENT  (of  the  mbmtrmct  entered  In  Block  JO,  II  different  from  Report) 


19-  KEY  WORDS  (Continue  on  reveree  tide  ll  neceeeary  end  Identify  by  block  number ) 

Utility,  Maintenance,  Productivity,  Organizational  effectiveness. 
Strategic  Air  Command,  Decision  theory,  Bayesian 


20.  ABSTRACT  (Continue  on  reverse  tide  It  neceeeery  end  Identify  bv  block  number) 

This  report  presents  a  detailed  accounting  of  a  study  to  measure  mainte¬ 
nance  productivity  and  to  explore  how  commanders  can  enhance  this  productivity  at 
the  Strategic  Air  Command  19th  Bomber  Wing  at  Robins  A.F.B.,  Georgia.  Utility 
models  for  the  Deputy  Commander  for  Maintenance  and  the  Squadron  Commanders  of 
the  Field  Maintenance  Squadron,  Organizational  Maintenance  Squadron,  Avionics 
Maintenance  Squadron  have  been  completed.  Those  factors  which  contribute  most  to 

maintenance  effectiveness  have  been  identified  and  the  relative  importance  of 
each  established 


I  JAN  7J  1473  EOVTION  of  I  NOV  65  15  OBSOLETE 


Uvd/t  ss\f,ej  y/sl  ooy~ 


& 


FINAL  REPORT 


Submitted  to 


AIR  FORCE  OFFICE  OF  SCIENTIFIC  RESEARCH 
AIR  FORCE  SYSTEMS  COMMAND 


UNITED  STATES  AIR  FORCE 


MAINTENANCE  PRODUCTIVITY 


Submitted  by 


DEPARTMENT  OF  INDUSTRIAL  ENGINEERING 


AUBURN  UNIVERSITY 


Administered  by 


ENGINEERING  EXPERIMENT  STATION 


Auburn  University,  Alabama  36849 


'  & 


l  / 


September,  1980 


A-' 


ait;  k.ircs  'toT-r:n;Tc  rese 

H(.~:  -  ■  -  -  , 


SEARCH  ( AFSC) 


T).  •  • 

r'-  "  '  i 

D  i  i.  *  T  .  .  .  ,  :  .. 

A.  L. 

rochnlw«il  Inr-ji-.t  •  (  io.;  ’iTicer 


"''vie-,  d  mid  Is 
i«  •'  A.  J..i  (7b) . 


ABSTRACT 


This  report  presents  a  detailed  accounting  of  a  study  to  measure  mainte¬ 
nance  productivity  and  to  explore  how  commanders  can  enhance  this  productivity 
at  the  Strategic  Air  Command  19th  Bomber  Wing  at  Robins  A.F.B.,  Georgia.  Util¬ 
ity  models  for  the  Deputy  Commander  for  Maintenance  and  the  Squadron  Commanders 
of  the  Field  Maintenance  Squadron,  Organizational  Maintenance  Squadron,  Avionics 
Maintenance  Squadron  have  been  completed.  Those  factors  which  contribute  most 
to  maintenance  effectiveness  have  been  identified  and  the  relative  importance 
of  each  established. 
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I.  INTRODUCTION 


A  problem  which  faces  most  organizations  is  the  requirement  for 
some  type  of  effectiveness  measurement.  Effectiveness  is  defined  as 
the  relationship  between  organizational  outputs  and  inputs.  This 
problem  is  usually  complicated  and  can  become  particularly  difficult 
in  a  non-profit  environment  when  effectiveness  has  many  objective  and 
subjective  characteristics.  If  organizational  outputs  are  measured  in 
several  areas,  the  problem  of  aggregating  the  measures  of  each  area 
into  one  overall  measure  of  effectiveness  arises.  Studies  of  the  abi¬ 
lity  of  humans  to  perform  complex  information  processing  indicate  a 
limited  capacity  in  terms  of  the  number  of  measurable  characteris¬ 
tics.1**^  These  measurable  characteristics  are  frequently  called 
attributes. 

This  concept  of  limited  human  information  processing  is  readily 
accepted  by  most  decision  makers  and  leads  to  a  decomposition  of  a 
situation  with  many  measurable  characteristics  into  individual  attri¬ 
butes  for  which  it  is  believed  organizational  effectiveness  can  be 
judged  quite  well.  This  decomposition  act  has  the  concurrent  require¬ 
ment  that  a  methodology  must  be  assumed  or  developed  which  will  com¬ 
bine  the  results  of  measuring  individual  attributes  into  an  overall 
measure  of  effectiveness.  Many  reported  applications  utilize  the 
assumption  of  a  simple  linear  addition  for  combining  individual  attri¬ 
bute  values  into  an  overall  single  measurement.  The  validity  of  the 
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assumptions  made  to  justify  use  of  this  single  linear  additive  utility 
model  is  often  questionable,  or  worse,  these  assumptions  are  ignored. 

More  generalized  approaches  are  available  which  yield  an  overall 
utility  model  for  a  decision  maker  which  more  accurately  reflects  the 
actual  environment  in  which  he  operates.  These  more  complex 
approaches  will  be  presented  in  Chapter  ZI. 

Multi-attribute  utility  theory  is  commonly  applied  to  those 
decision-making  problems  where  the  possible  decision  consequences,  or 
alternatives,  are  characterized  by  more  than  one  attribute.  For 
example,  a  manufacturer  contemplating  the  purchase  of  a  new  production 

■V 

machine  might  evalute  candidates  using  four  attributes:  initial  cost, 
operating  cost,  production  capacity,  and  compliance  with  safety  and 
environmental  regulations . 

In  this  study  multi-attributes  utility  theory  was  applied  in  a 
new  way  to  develop  an  overall  measure  of  effectiveness  to  provide  com¬ 
manders  with  a  mechanism  to  measure  the  effect  on  effectiveness  of 
various  decisions  they  make.  It  will  also  indicate  the  maximum  effec¬ 
tiveness  that  the  commander  can  expect  to  achieve  given  the 
constraints  under  which  he  operates. 

A  key  element  of  utility  theory,  and  a  possible  shortcoming,  is 
that  the  decision  maker,  with  the  assistance  of  analysts,  completely 
specifies  his  own  utility  function.  He  does  this  by  identifying 
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attributes,  specifying  attribute  utility  functions,  weighing  attri¬ 
butes,  and  by  responding  to  various  analysts'  questions  regarding 
attribute  independence  conditions  which  leads  to  the  form  of  the 
overall  utility  function.  Productive  interview  techniques  were 
employed  by  the  analysts  to  ensure  that  decision  makers'  responses 
were  accurate  and  consistent. 

The  criticism  of  utility  theory  centers  around  its  lack  of  trans¬ 
ferability.  Since  a  utility  function  explicitly  reflects  the  pre¬ 
ference  structure  of  a  single  decision  maker,  it  is  valid  only  for  him 
but  with  limited  success  may  be  transferred  to  a  different  decision 
maker  in  a  highly  structured  organization. 

This  study  is  concerned  with  the  measurement  of  effectiveness 


II.  LITERATURE  REVIEW 


This  chapter  is  divided  into  two  sections;  the  first  section  pro¬ 
vides  a  review  of  the  development  of  utility  theory  and  the  second 
section  deals  with  previous  research  concerning  the  measure  of  effec- 

t 

tiveness  in  the  United  States  Air  Force. 

Development' of- utility  Theory 

Although  the  concept  of  maximizing  expected  monetary  return  dates 
to  the  eighteenth  century,  modern  utility  theory  for  decision  making 
was  first  developed  in  1947  by  von  Neumann  and  Morgenstern  ' 4  who 
postulated  a  set  of  axioms  using  objective  probabilities.  They 
demonstrated  that  a  utility  value  could  be  assigned  to  each  possible 
decision  outcome  in  such  a  way  that  the  decision  maker  should  always 
choose  the  outcome  with  the  highest  expected  utility.  This  result  is 
referred  to  as  the  expected  utility  hypothesis. 

Savage  provided  the  next  major  contribution  in  1954  when  he 
presented  the  first  axioms  concerning  subjective  expected  utility, 
which  incorporates  subjective  probability  estimates  made  by  the  deci¬ 
sion  maker.  In  the  following  years  a  collection  of  results  for 
problems  involving  uncertainties  became  known  as  Bayesian  or  statisti¬ 
cal  decision  theory  as  presented  by  Schlaifer  Raiffa  and 

Schlaifer  and  Pratt,  et  al  The  application  of  statistical 

decision  theory  to  actual  problems  led  to  the  coinage  in  1966  of  the 
term  decision  analysis. 


Researchers  have  Investigated  more  specific  characteristics  of 
decision  problems  since  the  mid-1960s.  Pratt  dO),  schlaifer 
and  Novick  and  Lindley  have  explored  various  methods  to  assess 

utility  functions.  The  assignment  of  subjective  probabilities  was 
examined  by  Winkler  Edwards  Schlaifer  dU,  and  Tversky 

and  Kahneman  ^5).  Arrow  f*®)  and  Keeney  and  Kirkwood  developed 

results  for  group  decision  problems,  and  Fishburn  ( 18-20 ) t 
Poliak  ^2D,  Raiffa  <22)f  Keeney  ^22»  2^),  and  Keeney  and  Raiffa 
(2®)  investigated  multi-attribute  preferences. 

The  utility  functions  to  be  developed  for  Armament  Systems  and 
Computer  Sciences  at  Eglin  AFB  are  multi-attributed  in  a  partially 
risky  environment.  The  environment  is  partially  risky  because  some 
attributes  can  be  measured  with  certainty  while  for  other  attributes, 
only  the  probabilty  distribution  or  expected  value  of  an  attribute 
measurement  can  be  obtained.  However,  this  report  assumes  certainty 
for  all  attributes. 

A  simple  additive  utility  model  for  n  attributes  is  of  the  form: 


where 


u(x) 


Z  kiui(Xi> 

i-1 


u(x)  »  expected  total  utility  value 

k^  *  weighting  of  attribute  i,  i  »  1,  2,  ...,  n 
x^  «  a  specific  amount  of  attribute  i 


Ui(Xi)  “  expected  utility  of  x^ 


Since  the  term  utility  function  will  be  used  only  when  at  least  one  attri¬ 
bute  cannot  be  measured  with  certainty,  u(x)  will  hereafter  be  referred  to 
as  the  utility  of  x  with  the  understanding  that  u(x)  is  actually  the 
expected  utility  of  x. 

Fishburn  *  26 )  prove<j  that  the  additive  utility  model  for  two 
attributes,  say  X  and  Y,  is  applicable  if  and  only  if  X  and  Y  are 
additive  independent.  Attributes  X  and  Y  are  additive  independent  if 
the  paired  preference  comparison  of  any  two  lotteries,  defined  by  two 
joint  probability  distributions  on  X  by  Y,  depends  only  on  their 
marginal  probability  distributions. 

Fishburn  (26)  extended  this  result  to  the  general  n-attribute 
case.  Hie  utility  function  takes  the  form  of  equation  (2.1)  if  and 
only  if  the  set  of  attributed  (Xj_,  X2,  . ..,  Xn)  is  additive  indepen¬ 
dent.  That  is,  if  preferences  over  lotteries  on  xlP  x2,  ..., 

Xjj  depend  only  on  their  marginal  probability  distributions. 

In  order  to  get  a  better  feel  for  additive  independence,  consider 
e  conditions  under  which  it  can  be  assumed  that  two  attributes  are 
independent. 

Let  (AfB)  denote  a  lottery  yielding  consequences  A  and  B  with  an 
equal  probability  of  0.50.  This  is  commonly  referred  to  as  a  "fifty- 
fifty"  lottery.  Let  x  and  x'  be  specific  values  of  attribute  X,  and  y 
and  y'  be  specific  values  of  attribute  Y. 


Attributes  X  and  Y  are  additive  independent  if  the  decision  maker  is 
indifferent  (i.e.,  prefers  neither  over  the  other)  between  two  lotteries 
I>i  and  L2,  where  the  two  lotteries  are  defined  as  follows: 


1*1  -  ((x,y) ;  (x*  ,y' ) ) 


L2  *  ( (x,y’ ) ; (x‘ ,y) ) 


The  multilinear  utility  function  was  also  developed  by  Fishburn  d®) 
with  further  refinements  by  Farquhar  ^27)  and  takes  the  form: 


u ( x )  *  Z  kjUitxi)  +  Z  Z  ki.;u1(xi)u.;(xj) 
i-1  1  i=l  j>i  13  1  1  3 


+  Z  Z  Z  kijmui<xi>uj<xj>um(xm>  +  •••  + 

i-1  j>i  m> j 


(2.2) 


where  the  notation  is  identical  to  that  for  equation  (2.1)  except  for 
the  additional  weighting  constants  (k*s)  with  multiple  subscripts . 

The  determination  of  these  added  weighting  constants  is  given  in 
Keeney  and  Raiffa  (25). 


Hie  multi-linear  utility  function  is  applicable  only  when  each 
attribute  in  the  attribute  set  is  utility  independent  of  the  remaining 
attributes.  Let  denote  one  attribute  in  the  attribute  set  and 
let  Xj,  denote  the  complement  of  X^  (all  other  attributes).  X^  is 
utility  independent  of  its  complement  if  the  conditional  preference 
order  for  lotteries  involving  only  changes  in  the  level  of  attribute 
Xjl  does  not  depend  on  the  levels  at  which  the  attributes  in  X^  are 
held  fixed. 
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Keeney 


(28) 


presented  the  multiplicative  utility  function  in 


1974.  If  attributes  Xj_,  X2,  . ..,  Xn  are  mutually  utility  independent, 
then  the  utility  function  takes  the  form: 


n 

ku(x)  +  1  *  £  (kk^u^x^)  +  1 

i=l 

(2.3) 


where  k  =  constant  to  scale  u(x)  from  zero  to  one. 

Attributes  X].,  X2,  •••»  Xn  are  mutually  utility  independent  if 
every  subset  of  X  =  (X]_,  X2,  ...»  Xn )  is  utility  independent  of  its 
complement.  Note  that  the  assumption  that  is  required  for  the 
multiplicative  utility  function  is  more  restrictive  than  the  assump¬ 
tion  for  the  multilinear  model.  In  fact,  the  multiplicative  model  is 
merely  a  special  case  of  the  multilinear  model. 

The  multiplicative  utility  function  has  been  successfully  applied 
in  a  number  of  environments.  Keeney  and  Raiffa  (25)  presented  several 
example  applications. 

It  is  now  clear  that  the  form  of  the  utility  function  applicable 
in  a  given  decision-making  circumstance  depends  on  the  various  inde¬ 
pendence  conditions  that  exist  among  the  attributes. 

Measurement  of  Air  Force  Maintenance  Effectiveness 


A 


No  reported  application  of  utility  theory  to  the  measurement  of 
effectiveness  has  been  found,  either  in  the  public  or  private  domain. 
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Hays,  et  al  (29)  employed  utility  theory  to  evaluate  a  U.  S.  Navy  war¬ 
fare  system,  they  essentially  made  a  straight-forward  application  of 
Keeney's  multiplicative  model  and  developed  no  new  theory. 

Research  concerning  U.  S.  Air  Force  manpower  effectiveness 
abounds,  particularly  at  the  Air  Force  Human  Resources  Laboratory  at 
Wright-Patterson  AFB,  Dayton,  Chio  (3°).  These  studies  are  more 
narrow  in  scope  than  this  study  since  they  deal  only  with  manpower 
effectiveness.  Obviously,  the  measurement  of  effectiveness  must 
account  for  non-personnel  as  well  as  personnel  attributes. 

A  sampling  of  research  into  manpower  effectiveness  is  provided  by 
references  (D,  (3D,  (32)  ^  an<j  (33)^ 

The  Air  Force  Systems  Command  did  experiment  with  value  or  worth 
models  during  the  1960s.  Rand  Corporation  ( 34^  evaluated  these  models 
in  1976.  Honeywell  created  a  procedure  called  PATTERN.  Another 
program  called  TORQUE  was  also  developed  later  to  make  decisions  on 
missile  development.  These  models  were  additive,  hence  variables  were 
assumed  to  be  completely  independent  with  no  interaction.  These  and 
other  objections  forced  the  program  into  disuse. 


III.  PROBLEM  STATEMENT  AND  EXPERIMENTAL  DESIGN 


The  purpose  of  this  study  was  to  develop  utility  functions  which 
will  provide  a  measure  of  effectiveness .  These  utility  functions  can 
then  be  used  to  aid  commanders  in  their  attempts  to  enhance  productivity. 


A  description  of  the  process  of  utility  function  development 
follows.  Die  first  step  is  to  determine  which  factors  (attributes) 
the  appropriate  commander  considers  to  be  relevant  in  the  measurement 
of  effectiveness.  Die  attribute  identification  step  is  not  concerned 
with  relative  attribute  importance  but  solely  with  the  enumeration  of 
all  possible  attributes.  Diis  identification  is  no  trivial  step  as  an 
attribute  overlooked  can  significantly  change  the  form  of  the  overall 
utility  function.  Attributes  which  are  considered  to  be  insignificant 
by  decision  makers  should  not  be  discarded  at  this  stage.  Any  such 
attributes  will  emerge  during  attribute  weighting  and  can  be  elimi¬ 
nated  at  that  time.  A  decision  maker  may  be  reluctant  to  divulge  his 
complete  attribute  set  or  may  even  be  unaware  of  subconscience  attri¬ 
butes  which  can  only  be  exposed  with  the  help  of  analysts. 

Die  second  step  in  utility  function  development  is  to  determine  a 
quantitative  measurement  scale  for  each  attribute,  including  iden¬ 
tification  of  the  lowest  and  highest  possible  attribute  values. 
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Several  attributes  will  have  a  natural  measurement  scale  such  as 
average  experience,  manning  level,  work  time,  space,  and  budget. 

Other  attributes  will  require  an  arbitrary  measurement  scale  (such  as 
0  to  5  or  0  to  10 ) . 

The  third  step  is  to  develop  the  utility  function  for  each  attri¬ 
bute  over  the  entire  range  of  possible  attribute  values.  Each  utility 
function  is  scaled  such  that  a  utility  of  0  corresponds  to  the  least 
desirable  attribute  value  and  1  corresponds  to  the  attribute's  most 
desirable  value.  The  utility  function  expresses  the  utility  (or 
value)  to  the  decision  maker  for  each  possible  attribute  value. 

Analysts  can  employ  one  of  several  methods  available  to  determine 
a  person's  utility  function,  the  simplest  but  most  inconsistent  tech¬ 
nique  is  to  request  the  decision  maker  to  sketch  the  shape  of  his 
utility  function.  An  improved  method  is  to  ask  the  decision  maker  to 
estimate  his  utility  for  various  attribute  values  along  the  measure¬ 
ment  scale  and  from  these  estimates,  rough  in  the  utility  function. 

The  most  consistent  method  found  for  developing  utility  functions  is 
the  lottery  technique  described  by  Raiffa  ^ 28^  and  this  method  was 
used  in  this  study. 

The  fourth  step  in  utility  function  development  is  the  investiga¬ 
tion  of  attribute  independence  conditions.  The  form  of  the  overall 
utility  function  depends  on  the  existence  of  certain  independence 


condition*  among  the  attributes.  Two  types  of  independence  must  be 
investigated  -  preferential  independence  and  utility  independence. 

For  a  n-attribute  set  let  and  Xj  denote  any  two  attributes  and 
let  X^j  denote  the  complement  of  the  attribute  pair  and  Xj,  that 
is,  all  other  attributes.  X±  and  Xj  are  preferentially  independent 
(25)  0f  x^j  if  the  conditional  preferences  by  the  decision  maker  in 
the  (X^,  Xj)  space  given  Xi j  do  not  depend  on  the  particular  values  of 
the  attributes  in  X±j. 

Let  Xi  denote  the  complement  of  attribute  Xi  or  all  attributes  in 
the  attribute  set  except  X^.  Xi  is  utility  independent  (25)  Qf  if 
the  conditional  preferences  for  lotteries  on  Xi  give  Xi  do  not  depend 
on  the  particular  values  of  the  attributes  in  X^ 

One  or  more  of  several  methods  shown  in  Figure  1,  was  used  to 
handle  attribute  dependencies.  The  first  approach  consists  of  com¬ 
bining  dependent  (preferentially  or  utility  dependent  or  both)  attri¬ 
butes  into  one  attribute  which  encompasses  the  original  dependent 
attributes  and  which  possesses  the  desired  independence  properties. 

The  difficulty  with  this  approach  is  that  it  may  be  much  harder  for 
the  decision  maker  to  perform  the  necessary  tradeoff  analyses  which 
are  required  for  development  of  the  attribute  utility  function  and 
attribute  weighting. 

Another  approach  to  dealing  with  attribute  dependencies  is  to 
maintain  the  original  attribute  set  and  acknowledge  the  dependencies 


by  assessing  conditional  utility  functions  for  tha  affactad  attribu- 
tas.  this  method  posaa  addad  assessment  problama  just  aa  tha  first 
ona  doas.  Dacision  makers  may  find  it  vary  difficult  to  articulata 
conditional  utility  functions. 

A  pr agMtic  approach  which  has  baan  auccaaa fully  employed  (2S)( 
is  to  assume  that  tha  dasirad  indapandanca  conditions  axist  avan  if 
experimentation  fails  to  confirm  than,  this  assumption  may  be  valid 
whan  a  sensitivity  analysis  shows  that  tha  affactad  attributes  have 
little  Impact  on  tha  overall  utility  function.  Zt  cannot  be  justified 
otherwise. 

tha  fifth  step  in  utility  function  development  is  to  determine 
tha  weighting,  or  relative  importance,  or  each  attribute  in  tha 
overall  utility  function.  Each  attribute  scaling  constant  is  some 
number  greater  than  aero  and  lass  than  ona.  As  it  was  for  the  devel¬ 
opment  of  attribute  utility  functions,  a  lottery  technique  provides 
tha  most  consistent  results  for  attribute  weighting  (25>. 

For  a  n-attributa  set,  let  tha  vector  x*  danote  the  consequence  of 
each  attribute  at  its  least  desirable  level  and  x*  denote  the  consequence 
of  each  attribute  at  its  most  desirable  level.  Similarly  let  x*  and 
x*  denote  the  least  desirable  and  most  desirable  level  of  the  specific 
attribute  X^,  respectively.  Let  k^  be  the  weighting  for  attribute  and 
let  (x*t  x*,  p^)  denote  a  lottery  yielding  consequence  x*  with  probability 
Pl  and  yielding  consequence  x*  with  probability  1-p^.  Since  u(x* >  «  1  and 


u(X)  Exists 


u(x*)  «  0,  the  expected  utility  of  the  lottery  ie  p^d)  ♦  (1  -  PjHO)  “ 

.  The  decision  maker  is  asked  to  choose  a  value  of  p^  such  that  he  is 
indifferent  between  receiving  (xj,  x“,  ...,  x^_^  x*,  x*+^,  •••*  x*)  ^or 
certain  or  the  lottery  ( x*  jx* ,  p^ ) .  The  utility  of  the  certainty  equiva¬ 
lent  is  kjU^(x*)  ■  k^d)  -  k^.  Since  the  utility  of  (x*,  x* ) ,  ie  pi#  then 
k^  “  p^.  Thus  when  the  p^  values  are  selected  for  each  attribute,  the 
decision  maker  is  actually  weighting  each  attribute. 

The  sixth  step  in  utility  function  development  is  to  assess  the 
various  attribute  measurement  uncertainties.  The  probability  distri¬ 
bution  of  attribute  ratings  must  be  determined  for  all  attributes 
which  cannot  be  measured  with  certainty.  For  example,  a  commander  may 
subjectively  rate  morale  on  an  arbitrary  zero  to  ten  scale.  When  a 
morale  rating  is  made,  say  a  value  of  six,  the  following  questions 
must  be  answered. 

1.  Can  the  commander  state  with  certainty  that  the  current 
morale  is  at  the  six  level  on  the  attribute  measurement 
scale? 

2.  If  the  morale  rating  cannot  be  made  with  certainty,  is  the 
true  morale  equality  likely  to  be  higher  or  lower  than  the 
estimated  value?  If  so,  the  probability  distribution  of  the 
true  attribute  rating  may  be  symmetric  about  the  estimated 
value . 
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3.  What  is  the  maximum  error  possible  in  an  estimated  attribute 
value? 

The  answers  to  these  and  related  questions  will  lead  the  analysts 
to  the  form  of  the  attribute  measurement  probability  distributions* 
These  probability  distributions  will  then  be  used  to  calculate  the 
(expected)  utility  for  a  specific  attribute  measurement  if  that  attri¬ 
bute  cannot  be  measured  with  certainty. 

If  the  attributes  are  not  utility  or  preferential  independent  and 
sensitivity  forces  us  to  examine  the  relationship  of  conditionally 
related  variables.  Bell's  procedure  * 35^  may  be  used  to  approximate  to 

any  degree  of  accuracy  desired,  lhe  computation  required  is  to  assess 
2m  marginal  utility  functions  and  y(xi/Yi>  together  with  2m  -2 

corner  constants.  Pbr  example,  for  nw5,  too  many  utility  values  would 
result  for  most  analyst-decision  makers  to  access.  Fortunately  in 
most  cases  m  will  rarely  be  as  great  as  four  even  when  twenty  or  more 
variables  are  identified. 

The  final  step  is  to  determine  the  overall  utility  function. * 

The  second  goal  of  the  study  was  to  determine  how  the  various 
commanders  can  improve  effectiveness  as  measured  by  their  respective 
utility  functions.  This  process  consisted  of  two  stages.  The  first 
step  was  to  determine  the  set  of  decisions  that  are  made  or  could  be 


made  by  each  commander.  The  second  step  was  to  determine  quan¬ 
titatively  the  impact  of  each  commander's  possible  decisions  on  his 
overall  utility  value.  The  final  product  of  this  process  was  a  set  of 
decision/  attribute  relationships  which  can  aid  the  commander  by  iden¬ 
tifying  the  more  important  decisions  he  makes  or  could  make. 

The  analyst  must  in  some  way  confirm  that  the  completed  model 
does  in  fact  represent  the  true  preferences  of  the  decision  maker. 

If  the  number  of  attributes  is  small,  then  the  analyst  may  deve¬ 
lop  a  functional  design  to  validate  the  model.  A  factorial  experiment 
will  validate  the  model  and  psychological  tests  can  show  that  the 
model  does  produce  the  same  results  as  the  decision  maker's  holistic 
judgement.  Unfortunately,  the  number  of  questions  the  analyst  must 
ask  if  the  number  of  attributes  is  large  becomes  quite  large.  For 
example  for  five  attributes  using  only  two  levels,  at  least  25  -  2  = 

30  holistic  judgements  must  be  made.  Clearly  this  method  cannot  be 
used  for  organizational  models  having  5  or  more  attributes. 

A  less  reliable  approach  is  convergent  validity.  The  decision 
maker  makes  his  decision  for  some  example  and  this  result  is  compared 
to  the  model  prediction.  If  the  two  are  dissimilar,  an  investigation 
is  made  into  the  model  and  the  decision  maker's  response  to  determine 
the  error.  Again,  this  approach  is  limited  to  about  ten  factors. 

One  other  approach  has  been  tried  using  experts.  Several  experts 


are  asked  to  select  alternatives  holistically  and  by  their  model.  If 


most  of  the  variance  is  attributed  to  differences  in  alternatives , 
then  the  models  are  believed  to  be  accurate.  This  approach  is  being 
developed  to  validate  the  results  of  this  study. 

Another  approach  is  to  decompose  the  bilinear  model  such  that  Y^  - 
(Xj  ...Xn)  and  Y2  *  (X^  ...X,,,)  where  Y^  and  Y2  are  additive  indepen¬ 
dent.  Hie  analyst  would  then  use  the  functional  or  correlation 
approach  on  (Y^j  and  (Y2)  independently.  Finally,  the  analyst  would 
try  to  validate  u(Y^)  and  u(Y2)  together. 

Once  the  number  of  factors  exceeds  ten,  any  procedure  will  be 
subject  to  criticism  because  we  have  no  reference  by  which  to  judge. 
Hie  model  we  develop  is  the  reference,  but  the  human  mind  is  unable  to 
consider  more  than  ten  competing  attributes.  Hiis  situation  might  be 
considered  an  analyst's  "Catch  22",  At  any  rate  the  insights  gained 
into  the  decision  problem  may  be  of  value  and  obvious  modeling  errors 
are  detectable  by  "intuitive"  validation.  Fortunately  even  in  large 
organizations,  most  decisions  effect  only  a  limited  number  of 
attributes;  therefore,  giving  the  analyst  validation  information. 


Under  the  assumptions  of  preferential  and  utility  independence, 
it  followed  from  the  utility  theory  results  reported  by  Keeney  (24) 
that  the  project  utility  function,  u(x),  should  be  of  the  form 

n 

u(x)  =  E  kjUifx^)  (4.1) 

i«l 


n 

or  1  +  ku(x)  -  E  (1  +  kk^u^fx^))  (4.2) 

i=l 

where  u  and  the  are  utility  functions  scaled  from  zero  to  one,  n  is 
the  number  of  attributes,  the  k^  are  scaling  constants  with  0<ki<l, 
and  k^-l  is  a  nonzero  scaling  constant.  Equation  4.1  is  referred  to 
as  the  additive  utility  function  and  it  is  appropriate  whenever 
n 

E  kA  ?  1 
i=l 

The  least  and  most  desirable  levels  of  attribute  X  are  x  and  x*, 
respectively,  then  it  follows  that  the  individual  utility  functions 
were  scaled  such  that 


Ui(xi)  -  0 


(4.3) 


Furthermore,  the  use  of  equations  (43)  and  (4.4)  in  either  equation 
(4.1)  or  equation  (4.2)  yields 

u(Xi,x2)  »  u(x£, . . . ,xj-l,xj,xj+l, . . . ,x„)  *  (4.5) 


This  latter  result  means  that  the  scaling  constants  k^  are  simply  the 
probabilities  p^  such  that  the  evaluator  is  indifferent  between 
(xj,x£)  for  certain  and  a  lottery  yielding  either  x*  with  probability 
p^  or  x°  with  probability  (l-p^).  (For  details  see  Table  10,  Chapter 
VIII. ) 

Determination  of  Weighting  Constants  kj 

The  equivalence  of  k^  and  from  an  appropriate  lottery  deter¬ 
mination  as  discussed  with  equation  4.5  was  used  as  a  technique  to 
determine  the  k^  values  from  the  decision  maker.  Seven  different  lot¬ 
teries  were  posed  to  the  decision  maker,  one  for  each  attribute,  and 
he  was  asked  to  choose  the  p^  values.  The  evaluator  was  told  that 
there  was  no  requirement  for  the  sum  of  the  p^'s  to  be  one  and  that  he 
should  not  be  concerned  about  this. 

Determine  of  k 

By  evaluating  equation  4.2  at  x*  and  using  the  results  of  equation 
4.4,  it  follows  that 
n 

1  +  k  ■  2(1  +  kki ) . 

i-1  (4.6) 
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n  n 

Keeney  shows  that  if  £  k^  >1,  then  -1  <k  <0,  and  if  k^  <1, 

i*l  i»l 

then  k  >0.  An  iterative  procedure  of  estimating  a  value  of  k,  deter¬ 
mining  which  side  of  equation  4.6  is  larger,  and  improving  the  esti¬ 
mate  until  the  two  sides  are  equal  is  recommended.  Such  a  procedure 
was  programmed  and  utilized  in  this  application. 

Determination  of  Project  Utility  Functions 

The  utility  functions  cure  summarized  in  the  next  chapter  with  a 
complete  summary  of  all  the  attributes  and  constants  used  in  the  models. 
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IV.  RESULTS 


The  decision  makers  at  19th  Bomber  Wing  involved  in  this  study  are  at  the 
first  level  of  supervision.  The  analysts  interacted  with  the  decision  makers 
in  sessions  over  a  time  period  of  approximately  eight  months. 

Throughout  this  process  the  analysts  encouraged  the  development  of  a 
minimally  complete  and  "independent"  set  of  attributes.  The  analysts  posed 
questions  concerning  the  meaning  of  attributes  and  the  nature  of  scales  upon 
which  projects  could  be  rated  for  each  attribute.  While  the  decision  maker 
was  already  familiar  with  probabilistic  independence,  the  analysts  gave  elemen¬ 
tary  examples  of  preferential  and  utility  independence  as  guidance.  Despite 
the  encouragement  given  by  the  analysts  for  selecting  "independent"  attributes, 
the  decision  maker  was  told  to  always  hold  firm  to  any  selection  for  which  he 
felt  strongly  committed.  The  final  attribute  list  as  presented  herein  has 
truly  been  evolutionary  throughout  the  study  and  has  been  of  some  concern  in 
every  session  between  the  decision  maker  and  the  analysts. 

It  was  found  to  be  necessary  to  use  hierarchical  approaches  [10]  in  going 
from  broad  objectives  to  specific  attributes, 
a)  PCM  Attributes 

The  following  eleven  attributes  were  identified  for  the  DCM  as  being  im¬ 
portant  to  the  effectiveness  of  his  wing. 

112)  Sortie  proficiency  is  the  rating  of  sorties  flown  to  those  scheduled. 

As  most  sortie  aborts  or  cancellations  are  due  to  maintenance,  the  percent 
f lown  is  a  strong  measure  of  maintenance  effectiveness. 

Ill)  Availability  is  the  number  of  aircraft  physically  at  Robins  AFB  compared 
to  the  number  assigned.  Periodically  aircraft  must  be  thoroughly  gone  over 
by  a  special  maintenance  unit. 

121)  Timely  parts  supply  is  the  time  it  takes  to  receive  an  item  after  that 
item  is  required.  The  percent  of  maintenance  jobs  deferred  for  parts  measures 
the  timeliness. 
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122)  Quality  parts  is  the  condition  of  a  repair  part  when  received.  If 
the  part  does  not  work  or  must  be  repaired  before  use,  it  reduces  effective¬ 
ness.  The  percent  failed  measures  this  attribute. 

21)  Training  is  the  training  for  repair.  Training  is  necessary  to  assure 
qualified  people  to  replace  those  leaving  and  to  assure  new  items  are  properly 
maintained.  The  perecent  unqualified  on  the  MSEP  score  measures  the  effec¬ 
tiveness  of  training. 

221)  Morale  is  measured  on  a  0  to  10  ranking  by  the  DCM. 

222)  Environment  is  the  condition  either  controlled  or  uncontrolled  under 
which  the  men  must  work.  It  is  measured  by  the  percent  of  time  the  men  work 
in  a  controlled  environment. 

23)  Manning  is  the  effective  utilization  of  time  by  the  maintenance  per¬ 
sonnel.  It  is  measured  by  the  percent  of  hours  on  the  job  to  the  percent 
available. 

24)  Safety  is  measured  by  the  maintenance  man-days  lost  due  to  accidents 
on  or  off  the  job. 

31)  Budget  effectiveness  is  measured  by  the  percent  of  money  received 
to  the  money  requested. 

32)  Overall  effectiveness  of  the  use  of  money  is  measured  by  the  cost  per 
aircraft  hour. 


b)  AMS  Attributes 

The  Avionics  Maintenance  Squadron  Commander  indicated  that  fourteen  attributes 
were  necessary  to  determine  overall  effectiveness  of  the  squadron.  More  emphasis 
was  placed  on  skill  level  and  repair  equipment  than  the  DCM  indicated. 

111)  Equipment  well  repaired  is  measured  by  the  percent  of  the  equipment 
that  cannot  be  used. 

112)  Test  equipment  available  refers  to  required  test  equipment  to  do  properly 
and  quickly  AMS  tests.  Only  AMS  considered  this  as  important. 

121)  Timely  parts  is  the  same  as  the  DCM  except  that  measure  was  in  days  for 
delivery. 

122)  Quality  parts  is  the  same  as  the  DCM. 

13)  Floor  space  is  self  explanatory  aid  is  measured  by  the  percent  of  need. 
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21)  Safety  Is  man  days  lost  per  month. 


22)  Manning  Is  the  assigned  to  authorized  personnel.  Note  that  this 
definition  differs  from  the  DCM. 

2221,  2222,  2223)  The  number  of  months  each  skill  level  has  on  the 
same  type  system  is  considered  important  to  proper  maintenance. 

23)  Work  load  is  the  hours  per  week  personnel  must  work. 

241,  242)  Correct  and  timely  information  from  air  crews  and  among 
repairmen  is  important  out  to  effectiveness.  Each  is  measured  on  a 
scale  of  0  to  10. 

3)  Money  is  measured  by  the  actual  to  requested. 


c)  QMS  Attributes 


The  Organizational  Maintenance  Squadron  had  eleven  attributes. 

111)  Aborts  and  cancellations  is  roughly  equivalent  to  the  DCM's  sortie 
proficiency.  The  measure  was  percent  per  quarter. 

112)  Sorties  per  month  is  a  measure  of  the  level  of  activity. 

121,  122)  Timely  and  quality  parts  are  the  same  as  the  DCM, 

131)  Aircarft  parking  is  another  measure  of  space  on  the  basis  of  space 
per  aircraft.  Note  that  some  aircarft  must  be  parked  on  taxi  strips. 

132)  Inspection  facilities  is  the  OMS  need  for  space  and  is  measured  by 
number. 

211)  PRP  is  the  personnel  reliability  to  perform  on  nuclear  weapons  and 
is  measured  by  the  proportion  qualified. 

212)  Manning  is  defined  as  assigned  to  authorized. 

2131,  2132)  Skill  levels  7  and  5  were  considered  critical,  but  skill  level 
3  was  not. 

23)  Flight  line  communications  is  the  ability  to  communicate  by  vehicle 
to  aircraft  along  the  flight  line. 
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d)  FMS  Attributes 

The  Field  Maintenance  Squadron  commander  identified  19  attributes. 

111)  Red  x  is  a  maintenance  action  which  grounds  the  aircraft  until 
repaired  and  is  measured  by  the  percent  of  aircraft  with  red  x's. 

112)  Diagonal  is  a  maintenance  action  which  does  not  ground  the  aircraft 
and  is  measured  by  the  percent  of  aircraft  with  diagonals. 

121)  Ground  equipment  is  equipment  required  by  the  Field  Maintenance 
Squadron  and  is  measured  by  the  percent  out. 

122)  Test  equipment  is  equipment  required  to  determine  what  caused  a 
failure  and  is  measured  by  percent  out. 

131,  132,  133)  Aircraft  to  hangars,  test  cells,  and  corrosion  facilities 
are  measures  of  the  quantity  and  quality  of  the  space  provided. 

211)  Manning  is  again  defined  as  assigned  to  authorized. 

212)  Training  of  craftsmen  is  again  important  and  is  measured  by  failures 
per  month. 

2131,  2132,  2133)  Skill  level  for  7,  5,  and  3's  is  important  to  the  Field 
Maintenance  Squadron  as  well  as  the  other  squadrons. 

22)  Squadron  morale  is  measured  by  the  number  of  complaints  per  250  people 
per  year. 

221)  Working  conditions  is  measured  on  a  subjective  scale  of  0  to  10. 

222)  Living  conditions  is  measured  on  a  subjective  measure  on  a  scale  of 
0  to  10. 

23)  Safety  is  again  defined  as  man  days  lost  to  in  house  or  free  time 
accidents. 

2A)  Supervisors  is  an  attribute  which  relates  to  how  well  the  supervisor 
does  his  job  and  is  measured  by  repeat  write  ups  per  week. 

3)  Money  is  again  defined  as  funded  to  requested. 

4)  Environment  for  Field  Maintenance  refers  to  the  number  of  fuel  spills 
per  quarter. 


All  three  squadrons  had  to  have  repair  and  test  equipment.  The  percent  out 
on  each  of  test,  repair,  and  communication  equipment  measured  the  ability  of 
squadrons  to  repair  an  aircraft. 

All  four  commanders  cited  timely  parts  of  the  proper  quality  as  vital  to 
effectiveness. 

All  four  commanders  agree  that  facilities  of  the  right  type  with  adequate 
space  was  an  important  factor  in  effective  maintenance.  The  particular  measures 
varied  from  detailed  types  of  space  to  the  overall  amount  and  quality  as  measured. 

Within  the  second  major  factor  of  personnel,  all  four  commanders  agree  that 
safety,  manpower,  and  morale,  and  communications  were  important. 

The  measures  within  safety  were  man  days  lost  for  all  four;  however,  the 
distinction  between  air  crew  and  maintenance  crew  was  most  common. 

Under  manpower  only  one  commander  was  concerned  with  PRP  and  only  one  with 
supervision.  All  four  agree  the  training  and  experience  of  7  and  5  levels  were 
very  important. 

All  four  commanders  had  morale  as  a  factor  but  the  measures  and  importance 
varied  considerably.  The  analyst  broke  morale  into  working  conditions,  living 
conditions ,  and  working  hours . 

The  three  squadron  commanders  agree  that  communication  within  the  squadron 
is  important  and  two  commanders  wanted  good  communication  with  the  air  crew. 

All  four  commanders  agree  the  funded  to  requested  budget  was  important  to 
the  overall  effectiveness.  Only  the  DCM  cited  cost  per  aircraft  hour  as  a 
measure  of  overall  effectiveness. 


Inspections  were  not  regarded  as  an  element  of  effectiveness  even  though 
they  were  mentioned  initially  be  two  of  the  squadron  commanders.  Later  inter¬ 
views  revealed  the  commanders  considered  inspections  to  be  a  function  of  other 


factors  already  Included. 

While  complete  unanimity  was  not  present  among  the  commanders,  the  overall 
list  of  factors  seems  to  suggest  that  Individual  utility  models  in  SAC  may  be 
more  transferable  than  originally  believed  by  the  analyst.  The  hypothesis  that 
these  models  are  transferable  needs  to  be  tested  on  a  broader  scale. 

Utility  functions  for  the  individual  attributes  were  developed  for  the 
decision  maker  by  arbitrarily  assigning  utility  values  of  0  and  1  to  the 
smallest  and  largest  scale  values,  respectively,  and  then  determining  inter¬ 
mediate  values  were  developed  questions  and  comments  were  posed  in  an  effort 
to  be  sure  the  evaluator  understood  the  assignments.  The  results  of  the 
process  are  exhibited  in  Appendix  A. 

This  now  brings  us  to  some  of  the  findings  of  this  study  besides  the 
original  aim  to  determine  the  factors  of  maintenance. 

All  four  SAC  commanders  aggreed  that  the  utility  would  decrease  if  the 
experienced  people  now  leaving  were  not  sp laced  by  experienced  people.  They 
went  so  far  as  to  say  they  didn't  want  inexperienced  people.  If  they  were 
forced  to  take  in  inexperienced  people,  then  more  time  would  be  taken  away  from 
the  experienced  peoOle  to  train.  Performance  levels  are  high  in  SAC  but  the 
situation  is  deteriorating  rapidly  and  will  continue  to  do  so  over  the  short 
term  regardless  of  any  action  taken  at  any  level.  It  would  lessen  the  rate 
if  transfers  of  people  in  and  out  of  SAC  were  reduced. 

All  agreed  the  higher  reliability  of  equipment  would  leases  the  need  for 
manpower.  One  such  example  was  a  radio  with  MTBF  of  14  hours  lengthened  to 
over  200  hours.  The  repairmen  were  reduced  from  12  to  5  without  loss.  Such 
improvements  in  reliabi  and  reduced  complexity  would  help  the  manpower 
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situation. 


Also  all  agreed  that  the  Division  level  in  SAC  could  be  eliminated  without 
loss.  In  fact  if  the  experienced  people  were  sent  to  the  wings  some  improvement 
of  effectiveness  might  result. 
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Table  1 


a.  PCM  -  The  DCM  model  Is  as  follows 

UDCM(X)  -  .4(11  +  .5(.5U(XU1)  +  .3U(XU2)  +  . 2U(Xm)U(X112) )  ] 

[1  +  .5(.4U(X121)  +  .4U(X122)  +  .2U(X121)U(X122))]-l)/1.25 
+  .5[.3U(X21)+.15(.2U(X221)+.2U(X222)+.6U(X2n)U(X222)) 

+  .4U(X23)  +  .15U(X24)] 

+  .1(.4U(X31)  +  .2U(X32)  +  .4U(X31)U(X32)] 

U  (X)  -  .40951 
DCM  v  ' 

b.  AMS  r  The  AMS  model  is  as  follows 

n 

UAMS(X)  "  (1  +  “SW*"1 

i-1 _ 

k 

where  k  -  -.95235. 

UAMSW  *  ' 93285 

c.  QMS  -  The  OMS  model  is  as  follows 

uoms(x>  ■ + kki  »i  <v>  - 1 

i“i _ 

k 

where  k  -  -.97992. 

WX>  '  ' 67687 

d.  FMS  -  The  FMS  model  is  as  follows 

n 

UFMS(X)  -  17  (1  +  kki  u1(xi>>  ~  1 

_ 

where  k  -  -.98761 

Wx)  -  *9279 
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V.  Use  and  lap  lenten  tat  ion 


After  expending  the  effort  to  develop  a  model,  it  should  be  uti¬ 
lized.  the  only  reason  for  doing  such  an  exercise  is  to  aid  the  deci¬ 
sion  smker  in  analyzing  coa^>lax  decisions. 

the  first  use  of  the  process  is  to  gain  insight  into  the  decision 
to  be  made.  Even  if  no  nodal  was  created,  the  thought  and  con¬ 
sideration  given  to  the  decision  should  improve  that  decision.  The 
second  use  of  this  tool  is  an  aid  in  actual  decision  making,  the 
third  use  is  to  help  formulate  an  argument  or  a  position  paper  on  some 
subject,  the  greatest  use  of  the  theory  is  probably  for  one  time 
decisions;  however,  in  continuing  systems  the  third  use  may  prove  to 
be  of  great  value.  The  use  of  the  model  as  an  aid  in  making  decisions 
on  flextime  and  manpower  experience  is  given  in  Appendix  C. 

A  fourth  use  of  the  model  is  to  give  a  reading  of  the  current 
effectiveness  of  an  organization  by  means  of  a  value  of  the  utility 
function  as  recomputed  periodically. 

Decision  Aid 

the  utility  model  helps  a  decision  maker  gain  insight  into  the 
decision  he  must  make.  By  pinpointing  the  conflicts  and  the  impor¬ 
tance  of  those  conflicts,  he  is  better  able  to  make  a  sound  and 
reasoned  decision.  As  such  the  model  is  an  aid  to  decision  making. 
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No  decision  maker  should  place  complete  reliance  on  such  a  tool  since 
the  model  is  derived  using  subjective  attributes,  focus,  and  weights. 
Where  holistic  judgement  does  not  agree  with  the  model,  the  decision 
maker  should  consider  why  there  is  a  difference.  Perhaps  the  model 
should  be  modified  or  perhaps  his  holestic  judgement  did  not  account 
for  all  the  attributes  and  their  relations.  The  decision  maker  is 
responsible  for  his  decision  whichever  he  chooses  to  follow. 

Position  Paper 

the  greatest  use  of  the  utility  model  in  the  Air  Force  is  to  use 
it  as  a  guide  in  evaluating  alternatives  rather  than  to  use  the 
results  to  argue  the  pros  and  cons  of  each  alternative. 

A  general  focus  of  a  talk  to  convince  is  to  cite  a  specific  case 
symtomatic  of  the  problem,  then  to  show  that  the  problem  is  general  in 
nature.  This  procedure  should  generate  enough  interest  to  allow  a 
statement  of  the  point  or  course  of  action.  Next  the  briefer  must 
cite  what  would  happen  if  his  recommendation  is  followed.  The  utility 
approach  provides  arguments  for  the  adoption.  Next  the  speaker  must 
answer  anticipated  objections.  Again,  utility  theory  will  provide 
material  in  an  organized  way.  Finally  the  conditions  that  would  exist 
if  the  recommendations  were  adopted  can  be  estimated. 

Basically  the  whole  process  permits  a  tightly  reasoned  argument 
for  some  position  whether  presented  orally  or  in  writing. 


t 

I 

I 

i 
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Two  position  memos  are  shown  in  Appendix  C  to  illustrate  the  type 
of  reasoning.  The  first  of  these  positions  is  a  recommendation  to 
continue  flextime.  Note  that  this  recommendation  applies  only  to  SD 
under  the  decision  maker.  A  different  organization  or  the  same  orga¬ 
nization  under  a  different  commander  might  yield  a  completely  dif¬ 
ferent  answer  and  both  would  be  correct  on  an  objective  basis. 

Effectiveness  Clock 

Over  a  period  of  time  is  the  decision  maker  improving  his 
organization?  Periodically,  he  may  wish  to  evaluate  all  attributes 
and  compare  to  the  value  of  the  attributes.  As  the  first  derivative 
would  guide  the  decision  maker  to  the  factors  which  would  yield  the 
greatest  improvement,  the  decision  maker  may  wish  to  start  a  program 
to  improve  that  area. 

Another  area  not  to  be  overlooked  is  to  identify  how  the  people 
reporting  to  the  decision  maker  effect  the  clock.  A  careful  analysis 
would  show  the  maximum  value  at  which  the  decision  maker  could  operate 
his  organization.  The  decision  maker  could  take  the  greatest 
restraint  times  the  probabilty  of  removal  for  arguing  in  a  position 
statement. 

The  present  value  of  the  effectiveness  clock  for  Col  Lindsay  and 
Mr  Thoreen  is  shown  in  Appendix  D.  Any  change  either  from  within, 
from  outside,  or  by  deliberate  decision  may  effect  this  value.  For 


example,  a  busy  employee  may  retire  thus  lowering  the  value.  The 
question  for  the  decision  maker  is  what  steps  to  take  to  replace  this 
man  and  raise  his  organization's  effectiveness  back  to  the  level 
attained  prior  to  retirement.  In  this  way  the  effectiveness  clock  may 
be  used  to  spot  developing  troubles  and  correct  them  before  serious 
erosion  can  occur. 

By  the  use  of  the  above  type  of  model ,  the  static  model  developed 
in  this  report  could  become  a  dynamic  model.  The  decision  maker 
should  note  that  what  improves  effectiveness  on  a  one  time  occurrence 
may  have  the  opposite  effect  on  a  continuing  policy.  For  example, 
granting  a  single  parent  permission  to  be  excused  from  TDY  once  may 
improve  organization  effectiveness?  but  if  it  were  policy  to  excuse 
single  parents  from  TDY,  the  effectiveness  of  the  unit  might  be 
lowered. 


Transferability 

Does  a  model  transfer  to  a  new  decision  maker  performing  the  same 
job?  The  answer  to  this  question  is  unknown  for  Air  Force  organiza¬ 
tions.  The  high  degree  of  structure  in  the  Air  Force  leads  one  to 
suspect  that  at  the  higher  levels  in  the  hierarchy,  the  factors  would 
be  the  same.  The  individual  at tri butes  may  have  some  commonality,  but 


the  weight  given  various  factors  will  probably  differ. 


If  the  Air  Force  desired  to  have  commanders  use  this  tool  as  an 


aid  in  decision  making,  how  should  it  be  implemented?  The  following 
are  some  suggestions  for  implementing  the  model* 

First  the  commander  must  be  briefed  about  what  utility  theory  is 
and  what  it  will  do  for  him.  Hie  commander  must  understand  that  it 
will  help  him,  but  that  the  model  does  not  replace  his  decision 
making. 

After  briefing  the  commander,  the  problem  should  be  stated.  For 
organizational  effectiveness  the  problem  is  to  maintain  the  effec¬ 
tiveness  of  the  organization  at  as  high  a  level  as  possible.  Hie 
problem  statement  should  go  on  to  state  the  particular  decision  of  the 
organization  and  the  environment  in  which  the  organization  works. 

Next  the  commander,  with  the  aid  of  the  analyst,  should  go 
through  the  "quick  procedure"  shown  in  Table  2  and  a  guide  to  trade¬ 
offs  shown  in  Table  3.  Hiis  "quick  procedure"  will  take  four  to  six 
one  hour  sessions  depending  on  several  factors  such  as  desire  of  the 
commander  to  discuss  his  situation,  grasp  of  utility  models,  technical 
background,  etc.  A  period  of  pragmatic  validation  is  required  to 
determine  how  well  this  model  reflects  the  real  feelings  of  the  deci¬ 
sion  maker.  Actual  decisions  on  positions  are  used  to  judge  holistic 


34 


TABLE  2 


QUICK  PROCEDURE 

1.  Brief  Decision  Maker 

2.  State  Problem 

3.  Identify  Factors 

4.  Identify  Utility  Function  for  Each  Factor 

5.  Weight  Factors 

6.  Check  Assumptions 

a.  Utility 

b.  Preferential  Independence 

c.  Parametric  Dependence 

d.  Bell's  Procedure 

e.  Additivity 

7.  Formulate  Model 

8.  Validate  Model 

9.  Check  Uncertainty 


35 


I 


TABLE  3 


GUIDE  TO  LOTTERIES 


(1)  Utility  Independence 


Does  XA  change  when  x£  changed  to  X*? 


( 2 )  Additive  Independence 


Xjl> 


Xj2 ) 


(3)  Preferential 


il' 


o,  o /  •• 
Does  choice 

Xj2 9  °>  °>  °> 


'31' 


Xj2' 


1,  1,  1, 

It  If 


...) 


•  •  •  ) 
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TABLE  3  -  GUIDE  TO  LOTTERIES  (Cont’d) 


(4)  Conditional  Utility  Independence 


Let  *  c 

Does  X^  change  if  o  changed 
to  1? 

Does  change  if  c  changed 

toe*  and  above  was  Utility 
independent?  If  so.X^  is 
conditional  utility  indepen¬ 
dent  of  Xj. 


( 5 )  Rank  Heights 


For  that  value  of  p  for  which 
the  decisio  maker  is  indif¬ 
ferent  let  *  p. 
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vs  model  similarity.  Differences  must  be  accounted  for  during  vali¬ 
dation. 

Finally#  the  results  are  put  into  a  routine  system  either 
manually  or  interactive  on  the  computer  as  illustrated  in  Appendices  D 
and  F. 

Manual  Computation  (refer  to  Appendix  D  for  Tables) 

The  manual  procedure  consists  of  using  three  tables  to  compute  the 
various  utility  functions  in  the  hierarchy.  Step  one  is  to  examine 
the  current  values  in  Table  4 •  The  decision  maker  then  decides 
whether  a  contemplated  act  will  change  the  level  of  the  attribute.  He 
may  wish  to  refer  to  the  attribute  utility  functions  listed  in 
Appendix  D.  The  next  to  the  last  column  of  Table  4  is  the  new  value 
of  the  factor  and  the  last  column  is  the  new  value  of  the  utility 
function  as  calculated  by  the  formula  or  read  off  the  graph. 

Step  two  is  to  use  the  utility  values  found  in  step  one  to  com¬ 
pute  all  the  utility  values  in  the  hierarchy  using  the  model  given  in 
Table  5.  Step  three  is  optional  as  it  consists  of  expanding  Table  2 
by  summarizing  all  utility  values  into  it.  A  tabulation  which  may  be 
used  in  the  report  or  presentation  results. 

Step  four  is  to  examine  the  resulting  utility  values  carefully  to 
determine  if  it  coincides  with  the  intuitive  feel  of  the  decision 
maker.  If  it  does  not  agree,  the  decision  maker  should  ask  if  the 
disagreement  is  in  his  judgement  or  the  model  to  answer  this  question 
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each  attribute  must  be  must  be  carefully  examined*  If  the  difficulty 
cannot  be  resolved  the  decision  maker  goes  to  step  five* 

Step  five  is  to  call  the  analyst  in  to  help  find  the  difficulty. 
The  trouble  could  be  in  the  model  or  some  inconsistencey  in  the  deci¬ 
sion  maker. 

Computer  Interaction 

Die  computer  steps  are  precisely  the  same  as  the  manual  steps 
except  the  decision  maker  must  go  to  a  computer  terminal.  Exact  steps 
are  given  in  Appendix  B. 

Die  principle  advantage  of  the  computer  is  to  allow  the  decision 
maker  to  examine  the  improvement  in  utility  of  any  given  decision. 

This  flexibility  permits  many  decisions  to  be  examined  and  the  sen¬ 
sitivity  determined. 


Interpretation  of  Output 

Typical  output  of  the  computer  is  shown  in  Appendix  F.  Die 
utility  (U)  values  are  summarized  along  with  their  percent  change  for 
each  factor  in  the  hierarchy.  Die  percent  change  is  a  reflection  of 
the  subjective  feelings  of  the  decision  maker.  As  such  the  decision 
maker  should  critically  examine  all  the  changes  to  determine  if  his 
overall  judgement  agrees.  If  it  does  not,  then  he  needs  to  examine 
the  process  to  determine  where  his  true  feelings  differ  from  the  model 


Sources  of  error  can  come  from  several  assumptions 


1.  The  value  of  the  attribute  utilities  may  be  incorrect. 

2.  A  factor  may  be  missing. 

3.  The  independence  assumptions  may  have  been  incorrectly  assumed. 

4.  The  form  of  individual  attribute  utility  functions  or  their 
limits  may  be  in  error. 

Only  after  the  decision  maker  satisfies  himself  that  his  utility 
values  are  reflecting  his  own  feelings  and  perhaps  the  objective  data, 
should  he  proceed  to  make  a  decision  or  advance  a  position. 

Uncertainty 

In  this  study  the  most  likely  V'".iue  fo*  »  .ttribute  was  chosen 
for  development  of  the  utility  function.  Very  f  i^./ly  the  mi  del 
would  be  called  value  or  worth  function  a*  rnctc*  ty  was  not  built 
into  the  attribute  utility  functions.  Nevertheless,  the  model  as  for¬ 
mulated  could  easily  incorporate  uncertainty  into  it.  For  example,  if 
the  decision  maker  says  morale  is  6  on  a  scale  of  10,  the  analyst 
could  ask  for  highest  and  lowest  values.  If  the  decision  maker  says  7 
and  5,  the  analyst  could  assume  normality  with  mean  6  and  a  standard 
deviation  of  one-third. 

If  the  distribution  is  approximately  symmetric,  then  the  results 
of  using  the  model  without  uncertainty  is  approximately  correct.  If 
the  distribution  is  very  unsymmetric,  we  may  need  to  use  the  expected 
value . 
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If  the  decision  maker  is  interested  in  the  range  of  outcomes  rather 
than  the  expected  value,  then  uncertainty  should  be  assessed  for  this 
computation.  As  the  uncertainty  process  is  somewhat  lengthy,  it  is 
normally  emitted  on  the  initial  development  of  the  utility  model. 


Policy  Formulation 

This  study  did  not  attempt  to  address  the  question  of  policy  for¬ 
mulation  to  improve  utility  in  the  long  run.  This  study  took  a  static 
short  term  view,  normally  less  than  one  year.  Further  work  might  be 
done  to  determine  if  the  process  is  a  Markov  chain  with  a  constant 
transition  matrix.  If  this  were  the  case,  policy  might  be  established 
using  this  tool.  Indeed,  by  combining  this  result  with  dynamic 
programming  it  may  be  possible  to  formulate  optimal  policy. 
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VI.  CONCLUSIONS 


Utility  theory  is  an  aid  to  decision  making,  a  method  to  help 
construct  arguments,  and  a  way  to  gain  insight  into  problems.  As  such 
it  is  a  worthwhile  tool  for  the  decision  maker.  It  does  not  replace 
the  responsibility  of  the  decision  maker  to  examine  all  the  facts  and 
render  his  decision. 

Hie  decision  maker  in  this  process  has  an  opportunity  to  reflect 
on  what  is  important  in  the  effectiveness  of  the  organization.  This 
process  alone  might  justify  the  use  of  this  tool.  Certainly  there  are 
many  hard  tradeoffs  to  be  made  before  arriving  at  a  conclusion. 

The  present  state  of  the  art  calls  for  those  commanders  desiring 
to  use  this  procedure  to  volunteer  to  have  the  analyst  set  up  the 
model  with  him.  No  commander  should  be  directed  to  develop  a  model; 
because  the  nature  of  the  problem  requires  complete  support  of  the 
decision  maker.  If  one  is  forced  to  develop  a  model,  he  is  not  likely 
to  use  it  and  thus  the  exercise  would  be  of  no  value. 

Advantages 

Hie  chief  advantage  of  utility  theory  is  that  it  identifies  the 
important  variables  and  their  relationship.  When  the  decision  maker  is 
asked  to  justify  his  decisions  or  position,  he  can  state  his  feelings  in 
more  precise  terms. 
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If  subordinates  disagree  with  a  decision,  they  may  show  the  deci¬ 


sion  maker  the  factors  on  which  they  feel  he  erred.  The  commander 
should  be  able  to  head  off  arguments  and  hard  feelings,  thereby 
gaining  cooperation  for  his  position. 

Likewise  when  a  decision  maker  advances  a  position  to  his  superior, 
they  can  identify  the  areas  of  disagreement  more  sharply.  Perhaps  the 
larger  organization  has  factors  not  considered  by  the  subordinate 
organization  commander. 

Objections 

The  greatest  objection  given  to  utility  theory  is  that  it  is  not 
transferrable  to  others.  While  this  is  generally  true,  we  can  also 
make  the  same  claim  of  any  decision  making  process.  To  do  otherwise 
is  to  remove  the  decision  from  the  decision  maker.  Individual  dif¬ 
ferences  must  be  accepted  and  each  decision  maker  regarded  as  dif¬ 
ferent. 

Another  objection  is  the  time  to  conduct  a  study.  The  quick 
procedure  given  here  helps  overcome  this  objection;  however,  all 
important  decisions  should  be  deliverated  long  and  thoughtfully.  If  a 
decision  is  final  there  is  no  need  for  a  review  of  the  decision  model. 

If  a  decision  is  complex  and  far  reaching,  the  decision  maker  should 
expect  to  spend  time  on  all  facets  of  his  decision. 
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An  additional  objection  ia  that  the  coonander  should  develop 
policy  which  will  guide  hi a  organization  to  success  and  effectiveness. 
More  research  is  needed  to  develop  dynamic  utility  models.  Still 
another  objection  is  that  the  subjective  model  is  too  imprecise  and 
changes  for  the  decision  maker  from  time  to  time.  The  decision  maker 
may  want  to  know  how  his  feelings  change.  By  knowing  he  may  make  more 
rational  and  less  emotional  decisions. 

Results 

Utility  models  for  various  commanders  have  been  for¬ 

mulated  to  reflect  their  ideas  and  thoughts  on  how  to  judge  the  effec¬ 
tiveness  of  their  respective  organizations.  The  models  have  been 
programmed  to  permit  fast  and  accurate  estimates  of  the  utility 
values.  The  procedures  do  work. 

Hie  decision  maker  must  now  decide  to  use  this  tool  and  to  deter¬ 
mine  if  it  does  in  fact  help  him  to  improve  the  effectiveness  of  his 
organization.  At  worst  the  decision  made  using  this  tool  will  differ 
from  his  initial  feeling  and  he  will  have  to  study  the  situation  only 
to  find  the  model  is  incorrect.  Hie  process  should  help  the  decision 
maker  understand  his  problem.  In  some  cases  the  process  may  help  the 
decision  maker  make  a  better  decision.  In  the  middle  ground  the 
utility  model  may  confirm  what  he  believed  to  be  true,  but  it  should 
add  weight  to  his  argument. 

Other  than  time  spent,  the  process  cannot  hurt  the  decision  and 
it  may  help  it.  If  this  process  is  not  used,  what  else  can  be  used? 
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APPENDIX  A 
UTILITY  MODELS 


D.C.M.  ATTRIBUTE  SET 
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O.M.S.  ATTRIBUTE  SET 
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APPENDIX  B 

SAMPLE  INTERVIEW  FOR 
ATTRIBUTE  WEIGHTING 


Analysts  (A):  Now  we'd  like  to  ask  you  some  questions  which  force  you  to  make 
some  choices. 

A:  Let's  say  you  have  two  choices.  Choice  number  one  is  to  command  a 

maintenance  squadron  which  has  0%  backlog  of  equipment  to  be  repaired 
(attribute  number  1  for  A.M.S.).  There's  a  big  catch  to  this  choice 
however.  Every  other  attribute  is  at  its  least  desirable  level. 

Choice  number  two  is  a  gamble:  A  squadron  with  every  attribute  at  its 
most  desirable  level  or  each  attribute  at  its  least  desirable  level. 
There's  a  fifty-fifty  chance  of  winding  up  with  either  case. 

Squadron  Commander  (SC):  In  choice  number  one,  0%  backlog  is  all  I  get? 

A:  Right,  but  you  get  that  for  sure  while  there's  a  50%  chance  in  choice 

number  2  that  you  don't  even  get  that.  Of  course  there's  also  a  50% 

chance  that  you'll  get  everything-  every  attribute  at  its  most  desirable 
level. 

SC:  Well,  if  all  I  get  from  choice  number  one  is  0%  backlog,  then  I  would 
just  as  soon  take  my  chances  with  choice  two. 

A:  Fine.  What  if  we  change  choice  two  so  that  there's  only  a  30%  chance 

of  getting  every  attribute  at  its  most  desirable  level  and  70%  chance 

of  getting  every  attribute  at  its  least  desirable  level.  Now  which 
choice  would  you  make? 

SC:  That's  a  little  tougher,  but  I  think  I  would  still  take  my  chances  with 
choice  number  two.  Just  having  0%  backlog  doesn't  mean  that  much  to  me. 

A:  O.K. ,  let's  do  it  again.  What  if  there  was  only  a  20%  chance  of  getting 
every  attribute  at  its  most  desirable  level  in  choice  number  two? 

SC:  A  20%  chance  is  almost  a  long  shot.  I  guess  I'd  take  choice  one  which 
gives  me  something  for  certain  versus  an  80%  chance  of  getting  nothing. 

A:  What  if  the  probability  of  obtaining  all  attributes  at  their  most 
desirable  level  was  25%? 

SC:  I  just  don't  know.  I  guess  either  one. 


The  squadron  commander  is  indifferent  between  the  two  choices  at  a  probability 
level  of  0.25.  Thus  the  weight  for  this  attribute  is  0.25. 


88 


APPENDIX  C 

DECISIONS  EFFECTING 
PRODUCTIVITY 


Decision  Set  of  DCM 


_ Description _ 

On  an  exception  basis,  when  confronted  with  an  urgent  problem,  DCM 
can  recommend  maintenance  priorities  to  Wing  Commander  in  order  to 
maximize  use  of  expertise  in  maintenance. 

Example:  On  Friday,  DCM  may  recommend  that  (and  convince)  Wing 
Commander  to  forego  maintenance  efforts  on  a  Friday  flight  that 
is  "late"  in  order  to  have  "Monday's  aircraft"  ready. 

Straighten  out  paper  work  requirements.  May  use  rank  and 
authority  to  solve  subordinates  problems  in  completing  documenta¬ 
tion  of  Sortie  proficiency  reports,  for  example. 

When  over  budget  for  quarter  in  some  area,  can  shift  funds  from 
one  group  to  another.  Note:  Annual  budget  is  3.5-4  MM$. 

MSEP  scores,  evaluated  annually  by  SAC  can  influence  MSEP  scores 
by  requesting  Q.C.  personnel  to  be  highly  critical  during  inspec¬ 
tions.  Larsen:  "Our  inspectors  are  tougher  than  SAC" 

Recommend  training  for  repeat  write-up  offenders.  However, 
squadrons  make  training  decisions. 

Can  request  manpower,  but  actually  can  do  little  to  increase  man¬ 
power.  However,  can  shift  personnel  from  one  squadron  to  another 
temporarily . 

OER's  and  APR's.  OER  on  each  of  4  squadron  commanders  and  1 
maintenance  control  officer.  APR  on  Technical  Advisor.  APR 
requires  5  endorsements,  OER  requires  2  endorsements.  Part 
of  this  decision  is  the  endorsement  level.  For  good  performers, 
may  pass  on  to  higher  authority  for  endorsements  to  help 
subject's  career. 

Authorization  for  cannabilization  can  come  from  Maint.  Control 
Officer,  but  DCM  is  closely  involved  with  cannabilization 
decisions. 

Leaves  and  passes  for  staff  and  key  people  in  squadrons.  Places 
limit  on  number  of  key  people  that  can  be  on  leave  at  any  one 
time. 
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Recommend  maintenance  priorities 
Resolve  documentation  problems 
Shift  funds 

Request  more  critical  QC  inspection 
Recommend  training 
Request  manpower 

Endorsement  level  of  OER  and  APR 
Authorize  cannabilization 
Grant  leaves  and  passes 


Attribute/Decision  Relationship 
Direct  impact  on 

Indirect  impact  on  X222,  X121 

Direct  impact  on  X32>  X21  X23 

Direct  impact  on  X31,  X32>  X121 

Direct  impact  on  X21 

Direct  impact  on  X21 
Indirect  impact  on  X^ 

Direct  impact  on  X21>  X^,  x23 

Direct  impact  on  ^21 

Direct  impact  on  x12i»  x122 

Direct  impact  x22^ 


A 

A 


vcooNjaui^wrop 


F.M.S.  Decision  Set 


Decision  Number 


Decision  Number 
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Decision 

Leaves  and  passes 
Promotions  and  demotions 
Training 

Cross-training  recommendations 
Recommendations  for  awards  and  decorations 
APR,  OER 

Position  assignments 
Duty  hours  and  shifts 
Maintenance  and  cleaning  emphasis 


Attribute/Decision  Relationships 

Attribute  Number 
Has  impact  on 

Has  impact  on 

Has  impact  on  x213^»  X2132’  X2133  perhaPs  lon8  tera 
effect  on  X23 

Direct  impact  on  X212  has  impact  on  X21,  x2131*  X2132’ 

X2133  some  l®Pact  on  X22 
Direct  impact  on  X22 

Direct  impact  on  X22  has  impact  on  X^ 

Direct  impact  x111>  x112»  very  l®Pact  x221 

has  some  impact  on  x121>  X23>  X^,  X22 

Direct  impact  on  X.^,  x112>  X121’  If  over  8  hrs*  X23,X221,X22 

Direct  impact  on  Xjj^t  X112*  X121’  X23’  X24*  X4’  X22’  X221 
has  some  impact  on  x^22 


m 
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Decision  Number 


O.M.S.  -  Lt.  Col.  Patterson  -  Decision  Set 


Description 


Assignment  of  key  personnel  -  promote  to  branch  chief, 
down  grade,  etc.  Punishment  for  disciplinary  action 
(Article  IS,  denote). 

Eliminate  personnel  from  service  recommendation  (3912) 

Expenditure  of  funds:  equipment  vs.  aircraft  parts 

Assignment  for  mobility  and/or  Emergency  War  Order  (END) 
commitment 

Who  is  qualified  for  PRP. 


Decision  Number 


Decision  Number 


O.M.S.  Decision  Set 


Decision 

Assignment  of  key  personnel 

Eliminate  personnel  from  service  recommendation 
Expenditure  of  funds 

Assignment  for  mobility  and  Emergency  War  Order 
Commitment 

P.R.P.  Qualification 


Attribute/Decision  Relationships 


Attribute  Number 

Direct  impact  on  X233 
Indirect  impact  on 

Direct  impact  on  Xm,  Xm,  Xn2>  X2m>  X2U§  X222>  X21M 
Direct  impact  on  X!2i»  X3 

Direct  impact  on  Xm,  X121>  X14>  X112>  X212>  X2in>  Xm, 
X222*  X221’  X2132 

Direct  impact  on  Xm,  Xn2>  X212»  X2m,  X2U>  Xn32 


APPENDIX  D 


Ocher  Models 


Colonel  Lindsay  -  Commander  of  Armament  System 

Mr.  Thoren  -  Chief  of  the  Computer  Sciences  Directorate 

Eglin  AFB 
Florida 


THE  ARMAMENT  SYSTEMS  (SD)  MODEL 


This  study  was  conducted  with  the  Deputy  of  Armament  Systems  (SD), 
Colonel  James  Lindsay,  His  background  proved  to  be  ideal  for  the 
development  of  a  utility  model.  He  has  bachelor  of  science  degrees  in 
Chemistry  and  Mechanical  Engineering  and  later  received  a  master's 
degree  in  Business  from  Auburn  University.  Colonel  Lindsay  received 
his  commission  in  1952  and  flew  fighters  from  1952  to  1961  and  again 
in  1966-67  in  Vietnam.  He  went  into  systems  work  in  1963  and  has  con¬ 
tinued  in  systems  assignments  to  the  present  except  for  the  time  in 
Vietnam.  In  1975  he  became  Deputy  of  SD. 

The  overall  mission  of  SD  is  the  management  of  development  and 
acquisition  programs  related  to  conventional  weapons  systems. 

Colonel  Lindsay  sees  five  major  factors  as  important  to  accomplishment 
of  the  SD  mission.  These  are  personnel,  money,  facilities,  develop¬ 
ment,  and  personal.  The  personal  factor  proved  to  be  almost  insigni¬ 
ficant  in  comparison  to  the  other  major  areas.  The  hierarchy  of  fac¬ 
tors  and  attributes  are  shown  in  Figure  2.  The  attributes  are  the 
measured  or  estimated  variables  which  determine  the  overall  model. 


Attributes  and  Model  for  Colonel  Lindsay 


The  analysts  encouraged  the  development  of  a  minimally  complete 
and  "independent"  set  of  attributes  throughout  the  process •  Questions 
concerning  the  meaning  of  attributes  and  the  nature  of  scales  upon 
which  projects  could  be  rated  for  each  attribute  were  posed. 

Elementary  examples  of  preferential  and  utility  independence  were 
given  as  guidance.  Despite  the  encouragement  given  by  the  analysts 
for  selecting  "independent"  attributes,  the  decision  maker  was  told  to 
always  hold  firm  to  any  selection  for  which  he  felt  strongly  com¬ 
mitted.  The  final  attribute  list  as  presented  herein  has  truly  been 
evolutionary  throughout  the  study  and  has  been  of  some  concern  in 
every  session  between  the  decision  maker  and  the  analysts. 

It  ms  found  to  be  necessary  to  use  hierarchical  approaches  (25) 
in  going  from  broad  objectives  to  specific  attributes. 

Attribute  Definition 

The  overall  mission  of  SD  is  the  management  of  development  and 
acquisition  programs.  The  decisions  that  Colonel  Lindsay  considers 
important  in  the  accomplishment  of  the  SD  mission  are  given  in  Table 
1.  The  major  factors,  personnel,  money,  facilities,  development,  and 
personal,  are  broad  factors  which  do  not  lend  themselves  to  measure¬ 
ment,  and  must  be  broken  down  into  attributes  which  are  measurable  on 
either  objective  or  subjective  scales. 
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COLONEL  LINDSAY 


DECISIONS 


Dj_  Organization 

Dj^  Merge  SPOs 

D^2  Reduce  Staff 

D2  Facility  Requirements 

D24  Space 

D22  Equipment 

D3  Project 

D31  Type  of  Contract  (Influence) 

D32  Turn  Down 

d4  Personnel 

D4i  Approve  Position  Description 

D42  Request  People  or  Authorization 

D43  Administer  Punitive  Actions 

D44  Select  Personnel  for  Special  Projects 

D44i  Placement 

D442  Strategy  to  Develop 

D45  Administer  Awards 


under  the  broad  factor  personnel,  the  decision  maker  Identified 

I 

manning,  experience,  training,  morale,  and  time  allocation  as 
measurable  attributes . 

Manning  is  defined  as  the  manyears  required  to  accomplish  the 

I 

project  workload.  The  measure  chosen  for  this  attribute  was  manyears 

short  on  a  scale  from  400  to  zero.  ! 

I 

Experience  is  the  amount  of  work  performed  in  the  past  on  similar  ! 

jobs.  The  decision-maker  estimates  the  overall  experience  levels  on  a 

i 

scale  of  zero  to  three  with  zero  being  not  adequate,  one  is  adequate, 

two  is  very  good,  and  three  is  ideal.  , 

| 

Training  is  required  to  prepare  personnel  to  use  new  technology 
and  to  accept  promotion  into  more  responsible  positions.  Hie  percent 
of  total  time  spent  on  training  is  a  measure  ranging  from  none  to  the 
ideal  of  five  percent. 

Morale  is  an  attribute  which  may  be  broken  down  into  subattri¬ 
butes,  work  time,  awards,  upward  mobility,  and  morale.  Work  time  is 
ideal  if  the  employee  works  forty  hours  per  week  and  My  hours  over 
fifty  is  unacceptable.  The  percent  of  people  getting  awards  annually 
should  ideally  be  about  five  percent.  The  advancement  opportunity 
refers  to  the  rate  at  which  employees  are  promoted  to  better  paying 
and  more  responsible  positions.  The  upward  mobility  subattribute  is 
measured  on  a  subjective  scale  from  zero  to  five.  A  zero  implies  no 
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promotion  and  a  five  means  those  persons  seeking  and  deserving  promo¬ 
tion  are  promoted.  The  subattribute  morale,  measured  on  a  zero  to  10 
scale,  is  the  rating  of  the  attitudes  and  feelings  of  the  personnel 
about  their  work  environment. 

Allocation  of  employee  time  is  measured  by  percent  of  productive 
effort.  Items  such  as  nonproductive  meetings  reduce  the  percent.  The 
factor  is  subjectively  ranked  on  a  scale  of  zero  to  ten  (ideal). 

These  are  defined  to  be  zero  as  little  or  no  productive  effort,  five 
is  average  productive  effort  for  all  organizations  of  this  type  and 
ten  is  nearly  all  effort  is  productive. 

Money  is  a  major  factor  composed  of  organizational  and  program 
budgets . 

Organizational  budget  is  measured  by  a  ratio  of  actual  budget  to 
requested  budget  and  may  range  from  75  to  110  percent. 

Program  budget  is  measured  by  the  percentage  of  requested  funding, 
and  it  may  range  from  75  to  110  percent. 

Facilities  has  quality  and  space  as  measurable  attributes. 

Quality  refers  to  the  physical  characteristics  of  the  space  such 
as  noise  level,  air  conditioning,  communication  and  the  like.  This 
attribute  is  measured  on  a  subjective  scale  from  zero  to  ten. 


Space  is  the  average  square  feet  per  person  available  and  may 
range  from  60  to  130 • 

Development  including  acquisition  is  the  major  factor  which 
refers  to  the  actual  work  done  on  projects  by  inhouse/contracted 
people  and  the  contractor.  Development  effectiveness  is  measured  by 
performance  and  visibility  attributes. 

Due  to  the  importance  of  performance,  it  is  broken  down  into  the 
subattributes  of  cost,  schedule,  and  technical  achievement.  All  three 
of  these  subattributes  are  measured  as  a  percent  of  the  original 
goals. 


Visibility  is  a  measure  of  the  knowledge  of  managers  about  the 
project  and  project  progress.  This  attribute  is  measured  on  the 
monthly  report  showing  cost  and  schedule  to  earned  value.  It  ranges 
from  50  to  100  percent. 

Personal  consists  of  two  measureable  attributes,  job  satisfaction 
and  time  allocation.  Both  factors  are  subjectively  ranked  on  a  scale 
of  zero  to  ten. 

Table  2  summarizes  the  attribute  and  gives  the  relative  impor¬ 
tance  of  each  attribute  and  the  value  assigned  to  each  attribute  in 
Jan  80.  The  utility  functions  for  each  attribute  are  ai  .n 

Appendix  A. 
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Utility  Functions 

The  eighteen  measureable  attributes  identified  in  the  preceding 
section  must  be  functionally  related  to  utility.  In  all  cases,  the 
minimum  value  for  utility  is  zero  and  the  maximum  value  is  1.  For 
those  attributes  with  a  linear  relation,  the  function  is  very  straight 
forward.  For  the  nonlinear  functions  a  series  of  values  was 
established  and  a  quadratic  or  exponential  curve  fitted  to  the  values, 
this  approximation  appeared  to  be  close  enough  for  practical  evalua¬ 
tions.  The  utility  functions  are  summarized  in  Table  3  and  the  final 
model  in  Table  4.  the  final  model  is  a  partially  additive  multiplica¬ 
tive  model.  A  sample  computation  is  shown  in  Appendix  A.  the  model 
was  also  programmed  into  the  computer  and  a  sample  is  listed  in 


Appendix  B. 


TABLE  4 


COLONEL  LINDSAY  -  ATTRIBUTES 


ATTRIBUTE 

MEASURE 

RANGE 

K± 

(Ui)Xi) 

*1 

Personnel 

.5 

X11 

Manning 

Manyears  Short 

400  -  0 

.6 

1-.0025  (Xu) 

x12 

Experience 

Rate 

0-3 

.3 

.111  (X12)2 

x13 

Training 

%  On 

0-5 

.3 

.2  (X13) 

x14 

Morale 

.2 

x141 

Work  Time 

Hours/Week 

50  -  40 

.3 

i  -  .1  <x141  - 

40) 

x142 

Awards 

%/Year 

0-5 

.2 

.2  (X142) 

x143 

Advancement 

Opportunity 

Rate 

0-5 

.2 

.2  (X143) 

XI44 

Morale 

Rank 

0-10 

.4 

.i  x144 

x15 

Allocate 

Time 

Rank 

0-10 

.2 

.01  (x15)2 

X2 

Money 

.6 

x2l 

Organiza¬ 

tional 

Budget/Request 

75  -  110 

.3 

.000816  (X21  - 

75)2 

x22 

Programs 

%  Funded 

75  -  110 

.5 

.000816  (X22  - 

75)2 

x3 

Facilities 

.2 

x3l 

Quality 

Rank 

0-10 

.4 

.1  x31 

x32 

Space 

Square  Feet 

60  -  130 

.3 

!  _  e  -•0925(X32  -60) 

x4 

Development 

.7 

X4l 

Performance 

.9 

X4ll 

Cost 

%  On 

0  -  100 

.3 

.0001  (x4111)2 

TABLE  4  (Cont'd) 


ATTRIBUTE 

MEASURE 

RANGE 

Ki 

*412 

Schedule 

%  On 

0  -  100 

.2 

*413 

Technical 

Achievement 

%  On 

0  -  100 

.5 

*42 

Visibility 

Cost  and 
Schedule 

50  -  100 

.1 

*5 

Personal 

.25 

*51 

Job  Satis¬ 
faction 

Rank 

0-10 

.3 

*52 

Time 

Rank 

0-10 

.3 

Ui(Xl) 

.0001  (X412)2 

.0001  (x413)2 

.02  (X42)  -  1 

.01  (X51)2 
.01  (x52)2 


TABLE  5 


COLONEL  LINDSAY:  UTILITY  FUNCTIONS 


ATTRIBUTE 


*11 

Manning 

x12 

Experience 

x13 

Training 

x141 

Work  Time 

x142 

Awards 

x143 

Advancement 

Opportunity 

x144 

Morale 

*15 

Allocate 

Time 

X21 

Organiza¬ 

tional 

Budget 

x22 

Programs 

Budget 

X3l 

Quality 

x32 

Space 

X411 

Cost 

X412 

Schedule 

X413 

Technical 

Achievement 

MEASURE 

Manyears  Short 
(400-0) 

Rate  (0-3) 

%  On  (0-5) 

Hours/Week 

(50-40) 

%  Year  (0-5) 

Rate  (0-5) 

Rank  (0-10) 

Rank  (0-10) 

Budget/Request 

(75-110) 

%  Funded 
(75-110) 

Rank  (0-10) 

Square  Feet/ 
Person  (60-130) 

%  On 

%  On 

%  On 


RANGE 

1  -  .0025  (Xn) 

.111  (X12)2 

.2  (X13) 

1  -  .1 

(Xi4i  -  40) 

•2  (X^42) 

.2  (X143) 

.1  (X144) 

.01  (x15)2 

.000816 
(X21  -  75 ) 2 

.000816 
(X22  -  75 )2 

.1  x31 

1  -  «  -.0925 
(X32  -  50) 

.0001  (X4ll)2 

.0001  (x412)2 
.0001  (x413)2 


Present 
Xi  U* 
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TABLE  5  (Cont'd) 


ATTRIBUTE  MEASURE  RANGE 

X42  Visibility  Cost  &  Schedule  .02X4  -  1 

(50-100) 

X51  Job  Satis-  Rank  (0-10)  .01  (X51)2 

faction 

X52  Time  Rank  (0-10)  .01  (X52)2 

*Ui  must  be  between  0  and  1 
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TABLE  6 


COLONEL  LINDSAY'S  MODEL 

Ux  -  .2222  Vi  +  .2666  U2  +  .0888  U3  +  .3111  U4  +  .1111  U5 
-  .125  U15  +  .875  Ujpj 

°Zl  *  ”  *4  ull>  “  *2  u12>  "  *2  U13)  (1  -  >1333  U14)  -  U/-.6667 

U14  -  .273  U141  +  .182  U142  +  .182  U143  +  .363  U144 
■  .3  %  +  .5  U22  +  .2  U22) 

U3  -  .572  U31  +  .428  U32 

U4  ”  .1  U42  +  .  27  U4]_i  ♦  .18  U4j^2  ♦  *45  U433 
u|  -  .3  U51  +  .3  U52  +  .4  051  (U52) 


* Alternate  Form 

U2  -  [(1  +  .4  U21)  (1  +  .6667  U22)  -  11/1.3333 
U5  -  [(1  +  1.333  U51)  (1  +  1.333  U52)  -  11/4.444 
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COL.  LINDSAY 


Organizational  x  .  Budget/Request  75-110  .3  75  u(x.,)  «.000816(xol-75) 


TABLE  2  (continued) 


u(x) 


TABLE  3  (continued) 


TABLE  4 


COL.  LINDSAY 

u(x)  *  .2222u(x1)  +  .2666u(x2)  +  .0888u(x3>  +  .3111u(x4)  +  .llllu(x5) 

-  .2222(.4)  +  .2666 (.09)  +  .0888(,761)  +  .3111(.225)  +  .1I11(.175) 
=  .27 

u(xx)  *  .875u(x21)  +  .125(u(x15)) 

=  .875(.406)  +  . 125 ( . 36)  =  .4 

u(x21)  -  [(l-.4u(xn))(l-.2u(x12))(l-2u(x13))(l-.1333u(x14))-I]/-.6667 

-  [ ( 1— . 4 ( . I ) ) (l-.2(.444)) (1— . 2 ( . 4A) ) ( 1— . 1 333 ( .642) )-l] /-. 6667 
=*  .406 

u(x14)  -  .273u(x141)  +  .182u(x142)  +  ,182u(x143)  +  .363u(x144) 

-  .273(.6)  +  .182(1)  +  . 182(.03)  +  .363(.8) 

*  .642 

u(x2)*  »  .3u(x21)  +  .5u(x22)  +  .2u(x21)u(x22) 

*  .3(0)  +  . 5 ( . 18)  +  2(0) (. 18) 

=  .09 

u(x3)  *  .572u(x31>  +  .428u(x32) 

-  .572(.6)  +  .428(.975)  -  .761 

u(x4)  *  9u(x41)  +  .lu(x42) 

-  . 9 ( . 25)  +  .1(0)  *  .225 

ii(x4i)  -  3u(x4n)  +  2u(x412)  +  .5u(x413) 

-  .3( .25)  +  .2 (.25)  +  .5 (.25)  -  .25 
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TABLE  4  (continued) 


u(x5)*  -  .3u(x51)  +  .3u(x52)  +  .4u(x51)u(x52) 

-  . 3(.25)  +  . 3( .25)  +  .4(.25) (.25)  -  .175 


* Alternate  Form 

u(x2)  [(1  +  .6667u(x21))(1  +  .6667u(x22))  -  1]/1.3333 

u(x5)  =  [(1  +  1.333u(x51))(1  +  1.333u(x52))  -  1J/4.444 
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COL.  LINDSAY  -  ATTRIBUTES 


X11 

Manning 


1-.0025X.,,  0<x  .<400 
u(x. .)  =  {  11  ~  U~ 

1,  xn>400 


12 

Experience 


U(X12) 


.  lll(x12)  ,  0<x1?<3 


12- 


1  *  X12>3 


- 1— 

3.0 

RATE 


x 


12 
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COL.  LINDSAY  (continued) 


•2xu,  0<x13<5 


i,  xn>5 


x 


141 


Morale  -  Work  Time 


1.  * 


141 


>50 


l-.l(x141-40),40<x 
0  x 

’  141  <40 
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COL.  LINDSAY  (continued) 


X21 

Organizational  Budget  X21<2^ 

u(x21)  -  {  .0008I6(x21-75)2,  75<x21<110 

1.  x21>110 


BUDGET/REQUESTED 


X22 

Programs  Budget  ’  *22 

u(x22)  -  {  .000816 (x22-75) 2 ,  75<x22<110 

1,  X22>H0 


BUDGET/REQUESTED 


THE  COMPUTER  SCIENCE  (KR)  MODEL 


Mr.  Janes  L.  Thoreen,  former  Director  of  Computer  Sciences,  has  a 
very  strong  background  in  computer  sciences  and  mathematics.  He  has 
worked  on  computers  since  the  1950s  and  received  his  masters  degree  in 
mathematics  from  Florida  State  University.  He  previously  directed  all 
the  computer  science  activities  for  Eglin  Air  Force  Base.  The 
Computer  Sciences  Directorate  has  over  52  computers  including  the  IBM 
360,  CDC  6600,  and  Burroughs  4700.  Mr.  Thoreen  stated  that  the 
Computer  Science  mission  is  to  provide  computer  and  mathematical  sup¬ 
port  to  AD  and  the  Eglin  AFB  tenants.  He  reported  to  Colonel  Robbins, 
Chief  of  Staff,  AD,  and  had  over  200  people  reporting  to  him. 

Attributes  and  Model  for  Mr.  Thoreen 

The  mission  of  the  Computer  Science  Directorate,  KR,  is  to  pro¬ 
vide  support  in  the  computer  solution  to  problems.  Since  Computer 
Science's  roll  is  support,  the  factors  differ  greatly  from  KR  to  SD, 
but  the  same  basic  procedures  were  used  to  determine  the  model  for 
computer  science  as  was  used  for  armament  development. 

Attribute  Definition 

TVenty-one  attributes  were  defined  by  Mr.  Thoreen.  The  major 
categories  are  provide  service,  maintain  security,  personnel,  and 
developeient.  The  hierarchy  for  Mr  Thoreen  is  given  in  Figure  3.  The 
decisions  that  Mr.  Thoreen  considers  important  are  listed  in  Table  5. 


Providing  service  is  the  primary  function  of  the  computer  science 
directorate  and  is  broken  into  six  major  components  -  Computer 
Operations,  Data  Reduction,  Modeling,  Hardware,  Real  Time  Support,  and 
Physical  Facilities,  Computer  operations  has  subattributes  of  tech¬ 
nical  or  Burroughs,  the  base  record  system.  Technical  is  further 
divided  into  payment  for  service  and  customer  satisfaction.  Real  time 
support  is  broken  down  into  capacity  to  perform  simultaneous  missions 
and  failures  on  missions. 

Security  is  divided  between  property  damage  which  may  be  accidental 
or  deliberate  and  information  which  may  be  classified  as  private. 

Personnel  is  broken  down  into  training,  morale,  motivation,  and 
recruitment.  Recruitment  is  further  divided  into  timely,  quality  and 
affirmative  action  components. 

Development  of  the  Computer  Science  Directorate  is  a  major  factor 
considering  plans  and  thoughts  from  the  present  to  10  years  ahead. 

Mr,  Thoreen  defined  the  specific  attributes  as  follows: 

Pay  under  technical  computer  operations  is  the  percent  of  the 
costs  paid  for  by  users  of  the  service.  Ideally  125  percent  of  the 
costs  would  be  paid  to  permit  expansion  and  improved  capabilities  of 
the  service. 

Customer  satisfaction  with  computer  services  was  objectively 
ranked  on  a  scale  of  zero  to  five  with  two  having  no  utility.  TVo 
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FIGURE  3 

THOREEN  HIERARCHY 


. . 


MR.  THOREEN'S  DECISIONS 


1.  One  time  decision  to  get  a  large  computer  or  not. 

2.  Organizational  effectiveness. 


Variable 

D1 

D11 

d12 

d13 

°14 

d15 

d2 

d3 

°31 

d32 

d4 

°41 

d42 

d43 


Personnel 

Time  Allocation 

Selection  [Competence,  Grade,  EEO] 
Recruitment 

Dismiss  or  Withhold  Raise 
Install  Morale  Booster 
Computer  Equipment  Approval 
Operational 

Set  Priorities 
Resolve  Conflicts 
Strategy 

Jobs  to  Accept 
Computer  Configuration 
Building  Specs 


1 

l 

i 

j. 

r 

LL 


would  reflect  dissatisfaction  but  no  action  by  the  customers  to 
correct  the  situation. 

Burroughs  or  nontechnical  customer  satisfaction  was  measured  the 
same  as  the  technical  customers  on  a  scale  of  zero  to  5. 

Data  reduction  was  measured  by  the  percent  of  work  done  on  time 
and  would  range  from  50  to  100  percent. 

Modeling  also  was  based  on  percent  of  occasions  that  the  analysts 
met  the  required  need  and  could  vary  from  50  to  100  percent. 

Hardware  sufficient  to  do  the  requested  jobs  was  subjectively 
rated  on  a  scale  of  zero  to  10  with  five  being  unacceptable. 

Real  time  support  capacity  was  rated  by  the  number  of  simultaneous 
missions  the  system  could  handle  with  a  range  from  zero  to  six. 

Real  time  failures  per  year  measured  the  ability  to  accomplish  a 
mission.  An  average  of  one  failure  per  year  was  unacceptable. 

Physical  facilities  for  personnel  and  hardware  was  subjectively 
rated  on  a  scale  of  zero  to  10. 

Property  damage  whether  accidental  or  deliberate  was  rated  as  to 
vulnerability  on  a  scale  of  zero  to  10. 

Classified  information  violations  of  one  per  year  was  unaccept¬ 
able  as  was  the  violation  of  personal  or  proprietary  information  on 
private  parties. 
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Training  was  judged  on  percent  of  total  time  spent  on  training. 
Ideally  6  percent  of  the  time  would  be  spent  on  training. 

Morale  was  subjectively  ranked  on  a  scale  of  zero  to  ten. 

Motivation  reflected  the  number  of  people  who  were  highly  moti¬ 
vated  and  could  be  counted  on  to  keep  everything  moving  at  high  effi¬ 
ciency.  If  20  percent  of  the  people  were  highly  motivated  the  opera¬ 
tion  would  be  ideal.  If  more  than  20  percent,  conflicts  might  arise. 

Timely  recruitment  is  the  average  number  of  days  to  fill  a 
vacancy  and  ranges  from  zero  to  60. 

Quality  recruitment  refers  to  the  percent  and  potential  capabi¬ 
lity  to  do  computer  or  mathematics  work  and  was  subjectively  rated  on 
a  scale  of  zero  to  3. 

Affirmative  action  referes  to  number  of  various  minorities  on  the 
work  force.  Ideally  the  percent  wsuld  be  the  same  as  the  national 
average  of  the  minority  to  the  total  population. 

The  final  attribute  was  development ,  which  was  measured  by  the 
number  of  years  ahead  the  planning  for  the  future  are  done.  This 
might  range  from  zero  to  ten  years. 

The  function  for  each  of  the  attributes  is  shown  in  Tables  6  and 


7  while  the  relationship  of  factors  is  expressed  in  the  model  shown  in 


Table  8.  Hie  overall  model  is  a  partially  additive  multiplicative 
model.  No  attributes  were  considered  to  be  conditionally  dependent  on 


TABLE  7 


MR  THOREEN'S  FACTORS 


VARIABLE 

ATTRIBUTE 

WEIGHT 

LOW 

NOW 

HIGH 

U 

X1 

Provide 

Service 

.3 

X11 

Computer 

Operations 

.8 

Xlll 

Technical 

.7 

xmi  Pav 

% 

.5 

75,175 

82 

125 

e-(xllll“125)2 

16 

X1112  Cvstomer 

Rank 

.5 

2 

3 

5 

-.667+. 333X1112 

X112 

Burroughs 

Rank 

.6 

2 

4 

5 

-.667+. 333X^22 

x12 

Data 

Reduction 

%  On  Time 

.5 

50 

80 

100 

-1  +  .02X12 

X13 

Modeling 

%  Meets 

.1 

50 

90 

100 

— 1  +  . 02X^3 

x14 

Hardware 

Sufficient 

.08 

5 

8 

10 

•lx14 

x15 

Real  Time 
Support 

.7 

x151 

Capacity 

Simultaneous 

.5 

0 

3 

6 

.163X^53 

x152 

Failure 

Aborts/year 

.7 

1 

1 

0 

1-x152 

X16 

Physical 

Facilities 

Rating 

.05 

0 

9 

10 

-lx16 

X2 

Security 

.3 

X21 

Property 

Damage 

.3 

x211 

Accidental 

Vulnerability 

.8 

0 

9 

10 

•lx211 
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TABLE  7  (Cont'd) 


VARIABLE 

ATTRIBUTE  WEIGHT 

LOW 

NOW 

HIGH 

£ 

x212 

Deliberate 

vulnerability 

.8 

0 

5 

10 

•lx212 

x22 

Information 

.8 

x221 

Classified 

Violations/Year 

.8 

1 

1 

0 

1“X221 

x222 

Private 

.3 

x2221 

Personal 

Violations/Year 

.6 

1 

1 

0 

1-x2221 

x2222 

Proprietary 

Violations/Year 

.5 

1 

1 

0 

1-x2222 

x3 

Personnel 

.05 

X31 

Training 

%  Of  Time 

.3 

3,9 

3 

6 

e-(X31-6)2 

x32 

Morale 

Rank 

.1 

0 

9 

10 

*lx32 

x33 

Motivation 

%  People 

.1 

0 

20 

20 

•  05X33 

x34 

Recruitment 

.2 

x341 

Timely 

Days 

.5 

60 

60 

0 

1-.01667X341 

x342 

Quality 

Rank 

.7 

0 

2 

3 

. J33X342 

x343 

Affirm  Act 

% 

.7 

+0+Nat* 

70 

Nat 

e-(X343~Nat)2 

x4 

Development 

Years  Ahead 

.1 

0 

5 

10 

J 

•IX4 

*Nat  =»  National  Average  % 
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TABLE  8 


MR  THOREEN'S  ATTRIBUTES 


VARIABLE 


xim  p*y 


Present 
XI  U(X 


»-(xllll"125)2 


16 


x1112 

Customer 

— • 667+. 333Xm2 

x112 

Burroughs 

-.667+.333X112 

x12 

Data  Reduction 

-1  +  .02X12 

x13 

Modelling 

-1  +  .02X13 

x14 

Hardware 

•lx14 

x151 

Capacity 

.163X151 

x152 

Failure 

1“x152 

x16 

Physical 

Facilities 

-lx16 

x211 

Accidental 

•lx211 

x212 

Deliberate 

•lx212 

x221 

Classified 

1'x221 

x2221 

Personal 

1_x2221 

x2222 

Proprietary 

1_x2222 

X31 

Training 

e-<x3i-6)2 

x32 

Morale 

•lx32 

x33 

Motivation 

•  05X^3 

x341 

Timely 

!-• 01667X34^ 

TABLE  9 

MR  TROREEN'S  MODEL 

U(x)  -  .4  Ox  +  .4  U2  +  .0667  U3  +  .1333  U4 

JX  =  [  <  1-  .  7520n )  ( 1- . 47012  HI-.  094ul 3 ) ( 1-. 01SO14 ) ( 1- . 658015 ) < 1- . 04U16 ) -1 J /- . 97 
Jll  *  •  538  +  •  462 

Jlll  *  *5  °1111  +  *5  u1112 

315  “  t(i  -  *0285  U151)  (1  -  .04  U152)  -  l]/-.057 

:2  m  t 273  U21  +  .727  U22 

321  “  *5  °211  +  *5  °212 
322  =  *7  u221  +  *3  °222 

3222  ”  HI  “  *2  ^2221^  ^  —  .163  U2222 ^  “  1]/— .333 

J3  =  [(1  +  .456  031)(1  +  .152  U32)(l  +  .152  U33)(l  +  .304  U34)  -  1J/1.52 
fj4  ”  *  263  CJ34^  +  .  368  U343  +  •  368  U343 
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TABLE  10 (continued) 


Recruitment 


TABLE  10  (continued) 
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TABLE  11 


Classified  Violations/Year  1-0 


TABLE U  (continued) 
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TABLE  12 


MR.  THOREEN 

u(x)  *  .4u(x3)  +  .4u(x2)  +  .0667u(x3)  +  . 1333u(x^) 

*  .4( .5336)  +  .4(. 19)  +  .0667(.27)  +  - 1333C -5) 

=  .3741 

u(xx)  =  [(l-.152u(Xll))(l-.47u(x12))(l-.094u(x13))(l-.015u(x14) 
(1-.658u(x15))(1-.04u(x16))-1]/-.97 

-  [ C 1— - 152 ( . 4) ) ( 1— -47( .6) ) (l-.094( .8)) (1-.015( .8)) 

(l-.658( . 2445) ) (l-.04( .9) )-l]/-. 97  =  .5336 
u(xxi)  =  .538u(xin)  +  .462u(x112) 

-  .538( . 17)  +  . 462 ( .6665)  *  .4 

u(xm>  -  •5u(xmi)  +  •5“(*iii2) 

=  .5(.0007)  +  .5 (.3333)  *  .17 
u(x15)  =  [ (1-.0285u(x151)) (1-.04u(x152))-1]/-.057 

=  [ (1-. 0285 (.489)) ( 1— . 04 (0))— 1] /— .057  -  .2445 
u(x2)  -  .273u(x21)  +  .727u(x22) 

=  . 273( . 7)  +  .727(0)  *  .19 
u(x21)  -  .5u(x2u)  +  .5u(x212) 

»  .5(.9)  +  . 5 ( .5)  -  .7 
u(x22)  -  .7u(x221)  +  .3u(x222) 

-  .7(0)  +  .3(0)  -  0 

u(x222)  -  [(l-.2u(x2221))(l-.163u(x2222))-l]/-.3333 
[(1-.2(0))(1-. 163(0))-!]/-. 3333  -  0 
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TABLE  12  (continued) 


[(l+.456u(x  ))(1+.152u(x32))(1+.152U(x33))(1+.304u(x34))-1]/1.52 

[  (1+. 456(0) ) (1+. 152(. 9) ) (1+. 152(1) )(l+.304(. 267))-l]/l. 52  =  .274 
,263u(x34^)  +  .368u(x342)  +  *368u(x343) 

.263(0)  +  .368(.6666)  +  .368(.06)  -  .267 


-  mmmmmmmmrnm, 


141 


THOREEN  (continued) 
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Burroughs 
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U(X112) 


{  -.6667  +  .3333xh2,  2<xu2<5 


l,  x112>5 
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u(x12) 
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THOREEN  (continued) 


0,  x  <50 
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u(x^)  *  {  -1  +  .02x13>  50£x13<100 
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THOREEN  (continued) 
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THOREEN  (continued) 
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THOREEN  (continued) 
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APPENDIX  E 

SAMPLE  POSITION  STATEMENTS 

FLEXTIME 

MANPOWER  EXPERIENCE 


MEMO  FOR  THE  RECORD 


20  Mar  1980 


SUBJECT:  Flex  Time 


TO:  AD/SD  (Col  James  Lindsay) 

The  following  is  a  result  of  your  utility  model  and  is  based  upon 
your  value  judgements  regarding  the  change  of  flex  time  back  to 
rigid  time.  By  your  model,  flex  time  should  be  continued  in  SD. 

a.  By  your  value  judgements  the  overall  effectiveness  of  SD 
would  be  reduced  by  over  seven  percent  if  SD  were  to  return  to 
rigid  t»ime.  Most  of  the  loss  in  effectiveness  comes  from  lowered 
personnel  effectiveness  which  is  estimated  at  17  percent. 

b.  Personnel  showed  a  large  loss  in  morale  of  17  percent.  This 
loss  is  mainly  due  to  employee  attitude  after  the  change  and  would 
directly  effect  productivity  in  the  short  term  due  to  increased  gripe 
sessions.  Training  will  be  lowered  about  ten  percent  due  to  increased 
scheduling  problems.  Manning  effectiveness  will  be  lowered  about  ten 
percent  because  personnel  will  not  be  able  to  personalize  their  time 
under  rigid  time  the  way  they  could  under  flex  time. 

c.  Other  attributes  might  be  adversely  effected  by  a  return  to 
rigid  time.  No  attribute  would  increase  in  value.  The  actual  decline 
in  effectiveness  might  be  greater  than  estimated.  This  decision  is 
not  sensitive  to  changes  in  the  estimates. 

d.  The  Coirmander  of  AD  may  have  overriding  factors  not  in  the  model 
for  SD.  The  Comnander  of  AD  may  also  evaluate  a  factor  differently  at 
his  level  even  if  the  factor  is  in  the  SD  model.  For  example,  morale 
may  decline  for  SD  while  morale  may  improve  for  AD  as  a  whole  if  flex 
time  is  discontinued  in  SD.  If  either  of  the  above  is  true  and  strong 
enough,  then  the  Commander  of  AD  may  have  a  good  argument  for  discontinuing 
flex  time. 

e.  Critics  of  utility  theory  may  argue  the  model  is  not  valid. 

There  is  evidence  that  the  model  is  complete  because  the  wholistic 
judgement  of  the  SD  Commander  is  in  agreement  with  the  model.  As  more 
use  of  the  model  is  made,  the  case  for  a  complete  and  correct  model 
will  strengthen.  In  the  case  of  flex  time,  the  form  of  the  model  will 
not  effect  the  decision  as  no  attributes  improve  in  value. 

f.  If  any  of  the  values  for  attributes  within  the  SD  model  are 
disputed,  then  more  information  might  be  appropriate.  For  example,  if 
one  person  says  time  allocation  is  worse  under  flex  time  because  people 
"goof  off"  more  and  another  says  that  time  is  better  allocated  because 
each  worker  can  personalize  one's  schedule,  than  a  work  sampling  study 
might  swing  the  final  decision  either  way.  In  the  absence  of  such 
criticism,  no  further  study  need  be  done  on  flex  time.  The  basic 
decision  will  remain  unchanged. 


g.  The  evidence  shown  in  this  model  strongly  supports  the  decision 
to  continue  flex  time  in  SD. 


CHARLES  R.  WHITE,  Lt  Col,  USAFR  3  Atch 

1.  Table  I 

2.  Table  2 

3.  Table  3 


MEMO  FOR  THE  RECORD  14  March  1980 

SUBJECT:  [mproved  Effectiveness  Due  Manpower 


TO:  Col  James  Lindsay 

The  following  is  another  result  based  on  your  utility  model.  Your 
model  indicates  that  the  addition  of  100  people  with  your  anticipated 
experience  level  will  improve  overall  effectiveness  by  16.5  percent. 

[f  the  people  have  no  experience  the  improvement  is  13.5  percent 
while  people  with  ideal  experience  level  might  improve  effectiveness 

by  22.0  percent.  The  primary  area  of  gain  is  personnel  with  improve-  I 

ment  of  140  percent.  Morale  would  improve  13  percent.  The  impact  of 

manning,  both  direct  and  in  combination  with  other  attributes,  forms  ■ 

the  bas'is  for  this  great  improvement. 

'  * 

i 

.1 

CHARLES  R.  WHITE,  Lt  Col,  USAFR  Cy  to:  AD/CC  (Col  Talbot)  \ 
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TERMINAL  PROCEDURES 


The  following  instructions  should  be  followed  for  using  the  terminal. 

If  you  do  not  have  a  user  name  and  password,  you  should  complete  the 
form  on  the  last  page  of  the  manual.  Send  the  completed  form  to 
Mr  Fred  Joines ,  KRF,  882-4092.  Mr  Joines  will  also  demonstrate  the  terminal 
procedures  for  you. 

The  information  in  brackets  is  what  you  must  type  in.  On  the  same 
problem  I  have  boxed  in  the  information  you  would  type. 

[User  Supplied  Information] 

First  you  log  in  and  identify  yourself. 

[LOGIN,  "user  name,"  "password,"  SUP,  ADTCVC23] 


CCMiAND  -  [ATTACH,  GO,  UTILITY,  ID  =  "user  ID"] 


CCMMAND  -  [GO] 

The  information  fran  the  program  will  appear  as  shown  on  the  next  page. 
You  will  continue  on  the  terminal  until  you  enter  EXIT  upon  request  and 
then  either  go  back  to  start  over  or  log  off. 

[EXIT] 

COMMAND  -  [GO]  or  [LOGOUT] 
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UTILITY  MODEL  PROGRAM 


i 

1 


FOLLOWING  THE  PROMPT  (>)  EITHER: 

1)  ENTER  A  REVISED  STATUS,  OR 

2)  ENTER  A  "Y"  TO  ACCEPT  CURRENT  STATUS,  OR 

3)  ENTER  A  "C"  TO  ACCEPT  CURRENT  STATUS  FOR  ALL  REMAINING 

VARIABLES,  OR 


4) 

ENTER  A  "R"  TO  RETURN 

TO  THE  TOP  OF 

THE  LIST,  OR 

5) 

ENTER  "EXIT"  TO  EXIT 

THE  PROGRAM 

VARIABLE 

NAME 

CURRENT  STATUS 

RANGE 

REVISED  STATUS 

XI 1 

MANNING 

360.0 

400  -  0 

>365.0 

X12 

EXPERIENCE 

2.0 

0-3 

>y 

X13 

TRAINING 

2.2 

0-5 

>2.5 

X141 

WORK  TIME 

44.0 

50  -  40 

>y 

X142 

AWARDS 

5.0 

0-5 

>y 

X143 

ADV.  OPPORTUNITY 

1.5 

0-5 

>c 

UTILITY  MODEL 


ATTRIBUTE 

ATTRIBUTE 

CURRENT 

REVISED 

CURRENT 

REVISED 

UTILITY 

NUMBER 

NAME 

STATUS 

STATUS 

UTILITY 

UTILITY 

CHANGE 

XI 1 

MANNING 

360.0 

365.0 

.100 

.087 

-.013 

XI2 

EXPERIENCE 

2.0 

2.0 

.444 

.444 

XI 3 

TRAINING 

2.2 

2.5 

.440 

.500 

.060 

X14I 

WORK  TIME 

44.0 

44.0 

.600 

.600 

X142 

AWARDS 

5.0 

5.0 

1.000 

1.000 

X143 

ADV.  OPPORTUNITY 

1.5 

1.5 

.300 

.300 

X144 

MORALE 

8.0 

8.0 

.800 

.800 

XI5 

ALLOCATE  TIME 

6.0 

6.0 

.360 

.360 

X21 

ORG.  BUDGET 

75.0 

75.0 

0.000 

0.000 

X22 

PROGRAMS  BUDGET 

90.0 

90.0 

.184 

.184 

X31 

QUALITY 

6.0 

6.0 

.600 

.600 

X32 

SPACE 

100.0 

100.0 

.975 

.975 

X411 

COST 

50.0 

50.0 

.250 

.250 

X4I2 

SCHEDULE 

50.0 

50.0 

.250 

.250 

X413 

TECH.  ACHIEVEMENT 

50.0 

50.0 

.250 

.250 

X42 

VISIBILITY 

50.0 

50.0 

0.000 

0.000 

X51 

JOB  SATISFACTION 

5.0 

5.0 

.250 

.250 

X52 

TIME 

5.0 

5.0 

.250 

.250 

XO 

OVERALL 

.272 

.274 

.002 

DO  YOU  WANT  TO  REPLACE  CURRENT 

STATUS  WITH 

REVISED 

STATUS? 

(Y/N)  »■ 

- >y 

ENTER  "RESTART"  OR  "EXIT"  » - >restart 


